| US 7,609,859 B2 | ||
| Method and system for generating bi-linear models for faces | ||
| Jinho Lee, Belmont, Mass. (US); Baback Moghaddam, Cambridge, Mass. (US); Hanspeter Pfister, Arlington, Mass. (US); and Raghu Machiraju, Dublin, Ohio (US) | ||
| Assigned to Mitsubishi Electric Research Laboratories, Inc., Cambridge, Mass. (US) | ||
| Filed on Jun. 14, 2005, as Appl. No. 11/152,528. | ||
| Prior Publication US 2006/0280342 A1, Dec. 14, 2006 | ||
| Int. Cl. G06K 9/00 (2006.01); G06K 9/46 (2006.01); G06K 9/66 (2006.01); G06K 9/36 (2006.01); A61B 3/10 (2006.01) | ||
| U.S. Cl. 382—118 [382/115; 382/190; 382/285; 351/204] | 8 Claims |
| 1. A method for generating a bi-linear model of faces, comprising a processor for performing steps of the method, comprising
the steps of:
acquiring, for each of a plurality of faces, a plurality of 2D images, the plurality of images acquired with a varying poses
of the face and varying illuminations on the face;
acquiring, for each of the plurality of faces, a 3D shape model;
obtaining, for each of the plurality of faces, point-to-point correspondences using the 2D images and the 3D shape model;
determining, for each of the plurality of faces, a diffuse texture from the 2D images;
aligning the point-to-point correspondences and the diffuse textures into vectors;
applying a singular value decomposition to the vectors to determine a joint variation of both shape and illumination;
determining shape and illumination basis vectors from the shape and illumination; and
reconstructing corresponding shape and illumination bases from a linear combination of the shape and illumination vectors,
and a shape parameter to generate a bi-linear face model.
|