US 11,706,377 B2
Visual, depth and micro-vibration data extraction using a unified imaging device
Yoav Zuta, Tel-Aviv (IL); Gideon Carmon, Haifa (IL); Roi Levy, Rehovot (IL); and Guy Raz, Binyamina (IL)
Assigned to GENTEX CORPORATION, Zeeland, MI (US)
Filed by Gentex Corporation, Zeeland, MI (US)
Filed on Nov. 19, 2021, as Appl. No. 17/530,589.
Application 17/530,589 is a continuation of application No. 16/615,827, granted, now 11,182,915, previously published as PCT/IL2018/050761, filed on Jul. 12, 2018.
Claims priority of provisional application 62/531,417, filed on Jul. 12, 2017.
Prior Publication US 2022/0076436 A1, Mar. 10, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 7/521 (2017.01); H04N 5/222 (2006.01); H04N 13/254 (2018.01); H04N 13/271 (2018.01); G06V 10/143 (2022.01); G06V 20/64 (2022.01); G06F 18/214 (2023.01); G06V 10/141 (2022.01); G06V 10/764 (2022.01); G06V 10/80 (2022.01); G06V 10/145 (2022.01); G06V 20/10 (2022.01); G06V 40/10 (2022.01); G06V 20/59 (2022.01)
CPC H04N 5/2226 (2013.01) [G06F 18/214 (2023.01); G06T 7/521 (2017.01); G06V 10/141 (2022.01); G06V 10/143 (2022.01); G06V 10/145 (2022.01); G06V 10/764 (2022.01); G06V 10/803 (2022.01); G06V 20/10 (2022.01); G06V 20/64 (2022.01); G06V 40/103 (2022.01); H04N 13/254 (2018.05); H04N 13/271 (2018.05); G06T 2207/30268 (2013.01); G06V 20/593 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A unified imaging device comprising:
a light source adapted to project a predefined structured light pattern constructed of a plurality of diffused light elements onto a scene;
an imaging sensor that captures a plurality of images of the scene;
a processor that:
classifies at least one object present in the scene by visually analyzing at least one of the plurality of images;
extracts depth data of the at least one object by analyzing a position of at least one of the plurality of diffused light elements reflected from the at least one object; and
identifies at least one micro-vibration of the at least one object by analyzing a change in a speckle pattern of at least one of the plurality of reflected diffused light elements in at least some consecutive images of the plurality of images, wherein the change in the speckle pattern is identified by applying a speckle pattern translation to the speckle pattern with respect to at least one adjacent point in the speckle pattern, and wherein an angular velocity is indicative of the at least one micro-vibration.