US 11,720,325 B2
Automated assistant performance of a non-assistant application operation(s) in response to a user input that can be limited to a parameter(s)
Joseph Lange, Zurich (CH); and Marcin Nowak-Przygodzki, Bäch (CH)
Assigned to GOOGLE LLC, Mountain View, CA (US)
Filed by Google LLC, Mountain View, CA (US)
Filed on Apr. 16, 2021, as Appl. No. 17/233,223.
Prior Publication US 2022/0334794 A1, Oct. 20, 2022
Int. Cl. G10L 15/22 (2006.01); G06F 3/16 (2006.01); G10L 15/28 (2013.01)
CPC G06F 3/167 (2013.01) [G10L 15/22 (2013.01); G10L 15/28 (2013.01); G10L 2015/223 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method implemented by one or more processors, the method comprising:
determining that an assistant operation is compatible with an application that is executing at a computing device,
wherein the application is separate from an automated assistant that is accessible via the computing device;
causing, based on the assistant operation being compatible with the application, a selectable graphical user interface (GUI) element to be rendered at a display interface of the computing device,
wherein the selectable GUI element identifies the assistant operation and is rendered in a foreground of the display interface of the computing device;
detecting, by the automated assistant, a touch selection of the selectable GUI element by a user via the display interface of the computing device;
performing speech recognition on audio data that captures a spoken utterance that is provided by the user and is received at an audio interface of the computing device after the touch selection of the selectable GUI element,
wherein the spoken utterance specifies a particular value for a parameter of the assistant operation without expressly identifying the assistant operation; and
causing, in response to the spoken utterance from the user, the automated assistant to control the application based on the assistant operation and the particular value for the parameter,
wherein causing the automated assistant to use the assistant operation in controlling the application based on the assistant operation and the particular value is based on the touch selection of the selectable GUI element and the selectable GUI element identifying the assistant operation, and
wherein causing the assistant to use the particular value in controlling the application based on the assistant operation and the particular value is based on the spoken utterance specifying the particular value and being provided after the touch selection of the selectable GUI element.