US 7,612,909 B2
Image processing apparatus and method, and image-capturing apparatus based on the difference between a signal detected by a sensor and the real world
Tetsujiro Kondo, Tokyo (Japan); Junichi Ishibashi, Saitama (Japan); Takashi Sawao, Tokyo (Japan); Takahiro Nagano, Kanagawa (Japan); Naoki Fujiwara, Tokyo (Japan); Toru Miyake, Tokyo (Japan); and Seiji Wada, Kanagawa (Japan)
Assigned to Sony Corporation, Tokyo (Japan)
Appl. No. 10/362,141
PCT Filed Jun. 19, 2002, PCT No. PCT/JP02/06088
§ 371(c)(1), (2), (4) Date Oct. 03, 2003,
PCT Pub. No. WO03/001452, PCT Pub. Date Jan. 03, 2003.
Claims priority of application No. 2001-186407 (JP), filed on Jun. 20, 2001.
Prior Publication US 2004/0081335 A1, Apr. 29, 2004
Int. Cl. G06F 15/00 (2006.01)
U.S. Cl. 358—1.9  [382/236; 382/173; 348/413.1; 348/412.1; 348/416.1; 348/415.1; 348/699; 348/747] 44 Claims
OG exemplary drawing
 
1. An image processing apparatus to detect a mixed area from image data which is formed of a predetermined number of pieces of pixel data obtained by an image-capturing device including a predetermined number of pixels, the pixels having a time integrating function, the mixed area being obtained as the pixel data in which a plurality of objects are mixed in the real world, said image processing apparatus comprising:
a motion compensation unit configured to compensate for the motion of frames of the image data; and
an area detector configured to subtract pixel data at a corresponding position in the motion-compensated frames, determine a difference between the subtracted pixel data, and detect the mixed area based on the difference between the pixel data at the corresponding position in the motion-compensated frames,
wherein said area detector detects the mixed area to which the pixel data belongs when the difference is greater than or equal to a threshold,
wherein a shutter-time period is divided into a plurality of equal periods, each pixel data being divided in accordance with the plurality of periods and pixel data corresponding to each of the plurality of equal periods being obtained for estimating a mixed ratio of each pixel in the mixed area, and
wherein the motion compensation unit generates the motion-compensated frames by matching backgrounds of the image data.