US 11,818,455 B2
Devices, methods, and graphical user interfaces for depth-based annotation
Joseph A. Malia, Isle of Wight (GB); Mark K. Hauenstein, London (GB); Praveen Sharma, Brooklyn, NY (US); Matan Stauber, San Francisco, CA (US); Julian K. Missig, Burlingame, CA (US); Jeffrey T. Bernstein, San Francisco, CA (US); Lukas Robert Tom Girling, Bristol (GB); and Matthaeus Krenn, Sunnyvale, CA (US)
Assigned to APPLE INC., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Feb. 8, 2023, as Appl. No. 18/107,381.
Application 18/107,381 is a continuation of application No. 17/716,984, filed on Apr. 8, 2022, granted, now 11,632,600.
Application 17/716,984 is a continuation of application No. 16/997,860, filed on Aug. 19, 2020, granted, now 11,303,812, issued on Apr. 12, 2022.
Application 16/997,860 is a continuation of application No. 16/574,029, filed on Sep. 17, 2019, granted, now 10,785,413, issued on Sep. 22, 2020.
Claims priority of provisional application 62/739,178, filed on Sep. 29, 2018.
Prior Publication US 2023/0199296 A1, Jun. 22, 2023
Int. Cl. H04N 23/63 (2023.01); G06T 11/00 (2006.01); G06F 3/0488 (2022.01)
CPC H04N 23/631 (2023.01) [G06T 11/00 (2013.01); H04N 23/633 (2023.01); G06F 3/0488 (2013.01); G06T 2200/24 (2013.01)] 36 Claims
OG exemplary drawing
 
1. A method, comprising:
at a first device having a first display generation component, a first set of one or more input devices, and a first set of one or more cameras:
sending a request to a remote device to initiate a shared annotation session with a second device that includes a second display generation component, a second set of one or more input devices, and a second set of one or more cameras;
in response to sending the request to initiate the shared annotation session with the second device, receiving an indication of acceptance of the request to initiate the shared annotation session;
in response to receiving the indication of acceptance of the request to initiate the shared annotation session, displaying, via the first display generation component, a first prompt to move the first device toward the second device; and
after displaying the first prompt, in accordance with a determination that connection criteria for the first device and the second device are met, displaying a representation of a field of view of the first set of cameras in the shared annotation session with the second device, wherein:
the connection criteria require that at least a portion of the field of view of the first device and a portion of a field of view of the second device correspond to a same portion of physical environment surrounding the first and second devices, and
during the shared annotation session, one or more first virtual annotations corresponding to annotation input directed to a respective location in the physical environment by the first device is displayed via the first display generation component and one or more second virtual annotations corresponding to annotation input directed to the respective location in the physical environment by the second device is displayed via the first display generation component, provided that the respective location is included in the field of view of the first set of cameras.