US 11,816,850 B2
Three-dimensional object reconstruction
Riza Alp Guler, London (GB); and Iason Kokkinos, London (GB)
Assigned to Snap Inc., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Apr. 19, 2021, as Appl. No. 17/301,926.
Application 17/301,926 is a continuation of application No. PCT/EP2019/080897, filed on Nov. 11, 2019.
Claims priority of provisional application 62/768,824, filed on Nov. 16, 2018.
Prior Publication US 2021/0241522 A1, Aug. 5, 2021
Int. Cl. G06T 7/73 (2017.01); G06T 17/00 (2006.01); G06T 19/20 (2011.01); G06T 7/50 (2017.01); G06N 3/02 (2006.01); G06V 20/64 (2022.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06V 10/44 (2022.01); G06V 10/22 (2022.01); G06V 40/10 (2022.01)
CPC G06T 7/50 (2017.01) [G06N 3/02 (2013.01); G06T 7/75 (2017.01); G06T 17/005 (2013.01); G06T 19/20 (2013.01); G06V 10/225 (2022.01); G06V 10/454 (2022.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06V 20/64 (2022.01); G06V 40/103 (2022.01); G06T 2207/20084 (2013.01); G06T 2207/20221 (2013.01); G06T 2207/30196 (2013.01); G06T 2219/2004 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computer-implemented method for creating a three-dimensional reconstruction from a two-dimensional image, the method comprising:
receiving a two-dimensional (2D) image;
identifying an object in the image to be reconstructed and identifying a type of said object;
spatially anchoring a pre-determined set of object landmarks within the image;
extracting a 2D image representation from each object landmark in the pre-determined set of object landmarks to generate a plurality of 2D images each corresponding to a different object landmark;
identifying one or more missing object landmarks that are missing from the identified object;
applying a function to the 2D image representation to determine an orientation angle of each of a plurality of joints of the object, the function comprising summations in a numerator and denominator, the one or more missing object landmarks being excluded from the summations in the numerator and denominator;
estimating a respective three-dimensional (3D) representation for each of the plurality of 2D images including limiting an effect of the one or more missing object landmarks to generate a plurality of separate 3D representations of each of the different object landmarks corresponding to each respective one of the plurality of 2D images; and
combining the respective three-dimensional representations comprising the plurality of separate 3D representations of each of the different object landmarks resulting in a fused three-dimensional representation of the object.