US 11,816,907 B2
Systems and methods for extracting information about objects from scene information
Habib Fathi, Atlanta, GA (US); Miguel M. Serrano, Marietta, GA (US); Bradden John Gross, Atlanta, GA (US); and Daniel L. Ciprari, Atlanta, GA (US)
Assigned to POINTIVO, INC., Atlanta, GA (US)
Filed by Pointivo, Inc., Atlanta, GA (US)
Filed on Feb. 7, 2022, as Appl. No. 17/665,653.
Application 17/665,653 is a continuation of application No. 16/818,814, filed on Mar. 13, 2020, granted, now 11,244,189.
Application 16/818,814 is a continuation of application No. 15/875,149, filed on Jan. 19, 2018, granted, now 10,592,765, issued on Mar. 17, 2020.
Application 15/875,149 is a continuation of application No. 15/418,741, filed on Jan. 29, 2017, granted, now 9,904,867, issued on Feb. 27, 2018.
Claims priority of provisional application 62/451,700, filed on Jan. 28, 2017.
Claims priority of provisional application 62/288,520, filed on Jan. 29, 2016.
Prior Publication US 2022/0237885 A1, Jul. 28, 2022
Int. Cl. G06V 20/70 (2022.01); G06T 7/55 (2017.01); G06V 20/10 (2022.01); G06V 20/64 (2022.01); G06F 18/23 (2023.01); G06T 17/00 (2006.01)
CPC G06V 20/70 (2022.01) [G06F 18/23 (2023.01); G06T 7/55 (2017.01); G06T 17/00 (2013.01); G06V 20/10 (2022.01); G06V 20/64 (2022.01); G06V 20/647 (2022.01); G06T 2207/10028 (2013.01); G06V 2201/12 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A method of operating an autonomous vehicle in an environment comprising:
a. identifying an environment comprising a scene including one or more objects, wherein the environment has not previously been navigated by an autonomous vehicle;
b. introducing the autonomous vehicle into the environment, wherein the autonomous vehicle is configured with two-dimensional (2D) image capture capability;
c. navigating the autonomous vehicle around the scene and the one or more objects, wherein the navigation is by one or more of the autonomous vehicle, a computer, or a user;
d. acquiring a plurality of 2D images for the scene and the one or more objects via the autonomous vehicle;
e. processing the plurality of 2D images to generate 2D and 3D scene and object information, wherein the processing is by either or both of the autonomous vehicle or the computer and is conducted substantially in real time while the autonomous vehicle is navigating the environment;
f. processing the 2D and 3D scene and object information using either or both of projective geometry or a machine learning library comprising a priori scene and object information, wherein the processing is by either or both of the autonomous vehicle or the computer and is conducted substantially in real time while the autonomous vehicle is navigating the environment;
g. generating autonomous vehicle navigation information from the processed 2D and 3D scene and object information by either or the autonomous vehicle or the computer, wherein the autonomous vehicle navigation information is generated substantially in real time; and
h. incorporating the generated autonomous vehicle navigation information in the navigation of the autonomous vehicle in the environment.