CPC A63F 13/213 (2014.09) [A63F 13/211 (2014.09); A63F 13/212 (2014.09); A63F 13/5255 (2014.09); G06F 3/011 (2013.01); G06F 3/014 (2013.01); G06F 3/017 (2013.01); G06F 3/0304 (2013.01); G06V 40/11 (2022.01); A63F 2300/1012 (2013.01); A63F 2300/1031 (2013.01); A63F 2300/1087 (2013.01); A63F 2300/1093 (2013.01); A63F 2300/301 (2013.01); A63F 2300/303 (2013.01); A63F 2300/308 (2013.01); A63F 2300/538 (2013.01)] | 17 Claims |
1. A system for tracking hand movements of a user, comprising:
a first wearable device configured to be worn over a first wrist of the user, wherein the first wearable device has a first strap that wraps around the first wrist of the user, wherein the first wearable device has a first set of inertial sensors to generate first motion data regarding a movement of the first wrist during the movement of the first wrist;
a second wearable device configured to be worn over a second wrist of the user, wherein the second wearable device has a second strap that wraps around the second wrist of the user, wherein the second wearable device has a second set of inertial sensors to generate second motion data regarding a movement of the second wrist during the movement of the second wrist,
wherein the first and second wearable devices are configured to provide the first and second motion data to a processor for determination of a first set of positions and orientations of the first wrist and a second set of positions and orientations of the second wrist; and
a head-mounted display (HMD) configured to be worn on a head the user, wherein the HMD includes a camera configured to capture a plurality of images of the first wearable device and the second wearable device while the first and second wrists are in motion, wherein the HMD is configured to provide the plurality of images to the processor for determination of a third set of positions and orientations of the first wrist and a fourth set of positions and orientations of the second wrist,
wherein the HMD is configured to display interactions with a virtual object in a virtual environment based on the first and third sets of positions and orientations of the first wrist and the second and fourth sets of positions and orientations of the second wrist.
|