US 9,811,311 B2
Using ultrasound to improve IMU-based gesture detection
Boris Smus, San Francisco, CA (US); Christian Plagemann, Palo Alto, CA (US); Ankit Mohan, San Mateo, CA (US); and Ryan Michael Rifkin, Oakland, CA (US)
Assigned to Google Inc., Mountain View, CA (US)
Filed by Google Inc., Mountain View, CA (US)
Filed on Mar. 31, 2014, as Appl. No. 14/230,038.
Claims priority of provisional application 61/954,275, filed on Mar. 17, 2014.
Prior Publication US 2015/0261495 A1, Sep. 17, 2015
Int. Cl. G06F 3/16 (2006.01); G06F 3/01 (2006.01); G01S 1/76 (2006.01); G01S 11/14 (2006.01)
CPC G06F 3/167 (2013.01) [G01S 1/763 (2013.01); G01S 11/14 (2013.01); G06F 3/017 (2013.01)] 22 Claims
OG exemplary drawing
 
1. A computer-implemented method comprising:
determining, based on accelerometer or gyroscope data generated by one or more sensors on a first computing device, that a user of the first computing device is likely to have begun performing a movement using the first computing device;
after determining that the user of the first computing device is likely to have begun performing the movement using the first computing device and before the first computing device has identified a particular gesture corresponding to the movement, transmitting, from the first computing device to a different, physically separate, second computing device, data indicating that the user of the first computing device is likely to have begun performing the movement using the first computing device;
before the first computing device has identified the particular gesture corresponding to the movement, obtaining, by the first computing device, audio data corresponding to a sound generated by the second computing device in response to the first computing device transmitting data to the different, physically separate, second computing device indicating that the user of the first computing device was likely to have begun performing the movement using the first computing device;
before the first computing device has identified the particular gesture corresponding to the movement, identifying one or more frequency shift peak values from the audio data; and
identifying, by the first computing device, the particular gesture corresponding to the movement based at least on (i) the accelerometer or gyroscope data that was used to determine that the user of the first computing device was likely to have begun performing the movement using the first computing device, and (ii) the one or more of the frequency shift peak values that are identified from the audio data that (I) corresponds to the sound generated by the second computing device and (II) was obtained in response to the first computing device transmitting data to the different, physically separate, second computing device indicating that the user of the first computing device was likely to have begun performing the movement using the first computing device.