US 9,811,754 B2
Realogram scene analysis of images: shelf and label finding
Edward Schwartz, Menlo Park, CA (US)
Assigned to RICOH CO., LTD., Tokyo (JP)
Filed by Edward Schwartz, Menlo Park, CA (US)
Filed on Mar. 6, 2015, as Appl. No. 14/641,292.
Claims priority of provisional application 62/090,177, filed on Dec. 10, 2014.
Prior Publication US 2016/0171429 A1, Jun. 16, 2016
Int. Cl. G06K 9/46 (2006.01); G06K 9/62 (2006.01); G06K 9/18 (2006.01); G06K 9/52 (2006.01); G06Q 10/08 (2012.01); G06K 9/00 (2006.01); G06K 9/34 (2006.01); G06T 7/73 (2017.01); G06T 7/10 (2017.01); G06T 7/11 (2017.01); G06T 7/90 (2017.01)
CPC G06K 9/46 (2013.01) [G06K 9/00201 (2013.01); G06K 9/00771 (2013.01); G06K 9/18 (2013.01); G06K 9/342 (2013.01); G06K 9/52 (2013.01); G06K 9/6201 (2013.01); G06K 9/6218 (2013.01); G06K 9/6267 (2013.01); G06Q 10/087 (2013.01); G06T 7/10 (2017.01); G06T 7/11 (2017.01); G06T 7/73 (2017.01); G06T 7/90 (2017.01); G06K 2009/4666 (2013.01); G06K 2209/01 (2013.01); G06T 2207/10004 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method for identifying shelves and labels from an image of shelves, the method comprising:
receiving the image of the shelves;
identifying features based on groups of pixels in the image of the shelves;
identifying possible shelf and label locations in the image, based on appearance using the features;
choosing the best shelf and label locations from the possible shelf and label locations in the image using context of the possible shelf and label locations;
generating a shelf model having a first geometric parameter and a first color parameter, the first geometric parameter comprising an estimate of an average thickness of previously detected shelves;
generating a label model having a second geometric parameter and a second color parameter, the second geometric parameter comprising an estimate of a width of a label in the image;
processing the image using the shelf model and the label model to update the possible shelf and label locations in the image based on features and context of the possible shelf and label locations in the image; and
choosing final shelf and label locations in the image using the updated possible shelf and label locations.