US 11,808,599 B2
Route recording with real-time annotation and re-display system
Kai-Han Chang, Madison Heights, MI (US); and Thomas A. Seder, Fraser, MI (US)
Assigned to GM GLOBAL TECHNOLOGY OPERATIONS LLC, Detroit, MI (US)
Filed by GM Global Technology Operations LLC, Detroit, MI (US)
Filed on Nov. 24, 2021, as Appl. No. 17/534,987.
Prior Publication US 2023/0160715 A1, May 25, 2023
Int. Cl. G01C 21/36 (2006.01); H04W 4/46 (2018.01)
CPC G01C 21/3673 (2013.01) [G01C 21/3602 (2013.01); G01C 21/365 (2013.01); G01C 21/3608 (2013.01); G01C 21/3647 (2013.01); G01C 21/3697 (2013.01); H04W 4/46 (2018.02)] 16 Claims
OG exemplary drawing
 
1. A route recording with real-time annotation and re-display system, comprising:
a first automobile vehicle having one or more camera systems;
an imaging display device defining a head-up display (HUD) or a head-down display positioned within the first automobile vehicle and receiving camera imaging data from the one or more camera systems, the HUD or the head-down display having a video display screen presenting the camera imaging data either in real-time or re-displayed from a pre-recorded image file;
a microphone array receiving voice data of a first operator of the first automobile vehicle;
an annotated-recorded-route created by adding a user input of the first operator of the first automobile vehicle including the voice, the annotated-recorded-route identifying specific coordinates or locations along a travel route driven by the first automobile vehicle including the voice data after activating recording of the camera imaging data to generate annotated features along the annotated-recorded-route; and
a second automobile vehicle having a second operator, the second automobile vehicle adapted to receive the annotated-recorded-route from the first automobile vehicle, the second automobile vehicle having an augmented reality HUD presenting a highlighted upcoming travel portion of the travel route overlayed on a windshield of the second automobile vehicle, wherein as the second automobile vehicle encounters the annotated features identified by the first operator of the first automobile vehicle, a symbol on the augmented reality HUD of the second automobile vehicle is overlayed on an object viewable through the windshield of the second automobile vehicle, wherein the symbol corresponds to an annotation of the annotated features identified by the first operator.