US 11,753,181 B2
System and method for visual aided landing
Yang Liu, Shanghai (CN); Wenwan Feng, Shanghai (CN); and Chao Wang, Shanghai (CN)
Assigned to HONEYWELL INTERNATIONAL INC., Charlotte, NC (US)
Filed by HONEYWELL INTERNATIONAL INC., Charlotte, NC (US)
Filed on Mar. 30, 2021, as Appl. No. 17/217,437.
Prior Publication US 2022/0315242 A1, Oct. 6, 2022
Int. Cl. G06F 17/00 (2019.01); B64D 45/08 (2006.01); G06V 10/44 (2022.01); G06V 20/10 (2022.01); G08G 5/00 (2006.01)
CPC B64D 45/08 (2013.01) [G06V 10/44 (2022.01); G06V 20/182 (2022.01); G08G 5/0047 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A system for providing visual cues to an aerial vehicle operator, the system comprising a controller configured to:
determine when a vehicle is on final approach to a landing runway based on monitored aerial vehicle status information;
process, responsive to determining that the vehicle is on final approach to the landing runway, a plurality of ground images of a ground path ahead of the vehicle retrieved from an image sensor on the vehicle;
identify a lane in the processed ground images;
determine whether the identified lane from the processed ground images corresponds to an assigned runway for landing based on a relative position of the identified lane relative to another lane in the ground images or a relative geometry of the identified lane relative to another lane in the ground images when landing zone markings are not recognized in the ground images or recognized landing zone markings in the ground images are not sufficient to determine that the identified lane is the assigned runway;
track during landing, based on the processed ground images, a left and a right side edge, a front edge, and a runway center line of the assigned runway;
determine, relative to the runway center line, whether a relative position of the vehicle during landing is left of, right of, or aligned with the runway center line; and
provide visual and/or audible guidance to the vehicle operator to take corrective action when the relative position of the vehicle during landing is not aligned with the runway center line.