| US 11,816,757 B1 | ||
| Device-side capture of data representative of an artificial reality environment | ||
| Melissa Erin Summers, Charlotte, NC (US); Lindsay Young, San Francisco, CA (US); Arthur Bodolec, New York City, NY (US); Adam Hupp, San Francisco, CA (US); Bryan Alger, Dallas, TX (US); Peter Aubrey Bartholomew Griess, Dallas, TX (US); Nataraja Kumar Koduri, Irving, TX (US); Carl Taylor, Palo Alto, CA (US); Bryan Justice, Sunnyvale, CA (US); Andrea Zeller, Bothell, WA (US); and Ayfer Gokalp, Kirkland, WA (US) | ||
| Assigned to META PLATFORMS TECHNOLOGIES, LLC, Menlo Park, CA (US) | ||
| Filed by Meta Platforms Technologies, LLC, Menlo Park, CA (US) | ||
| Filed on Dec. 11, 2019, as Appl. No. 16/710,738. | ||
| Int. Cl. G06T 1/60 (2006.01); G06F 3/01 (2006.01); G06T 17/20 (2006.01); G06T 19/00 (2011.01) | ||
| CPC G06T 1/60 (2013.01) [G06F 3/011 (2013.01); G06F 3/017 (2013.01); G06T 17/20 (2013.01); G06T 19/006 (2013.01)] | 17 Claims |
|
1. An artificial reality system comprising:
an application engine configured to generate artificial reality content based on a pose of a user participating in an artificial reality environment; and a head-mounted display (HMD) configured to output the artificial reality content to the user, the HMD comprising:
a buffer configured to hold data representative of the artificial reality environment during a time window on a rolling basis, wherein the data representative of the artificial reality environment represents a view of the artificial reality environment from a position of the user, wherein the data representative of the artificial reality environment represents full state data that is more comprehensive than the artificial reality content output to the user, wherein the view of the artificial reality environment represents a 360 degree view of the artificial reality environment from the position of the user, wherein the view of the artificial reality environment includes data representative of one or more objects that are within a field of view of the HMD and data representative of one or more objects that are outside of the field of view of the HMD, and wherein to hold the data on the rolling basis, the buffer is configured to:
continuously save the full state data representative of the artificial reality environment representing the view of the artificial reality environment that is generated during the time window immediately preceding a current point in time, the view of the artificial reality environment including the data representative of the one or more objects that are within the field of view of the HMD and the data representative of the one or more objects that are outside of the field of view of the HMD; and
continuously drop the full state data representative of the artificial reality environment representing the view of the artificial reality environment that is generated prior to the time window, the view of the artificial reality environment including the data representative of the one or more objects that are within the field of view of the HMD and the data representative of the one or more objects that are outside of the field of view of the HMD; and
a capture engine configured to, in response to user input, capture the full state data representative of the artificial reality environment held in the buffer at a point in time at which the user input was received.
|