US 11,816,926 B2
Interactive augmented reality content including facial synthesis
Ivan Babanin, London (GB); Valerii Fisiun, Kyiv (UA); Diana Maksimova, London (GB); and Alexey Pchelnikov, London (GB)
Assigned to SNAP INC., Santa Monica, CA (US)
Filed by Snap Inc., Santa Monica, CA (US)
Filed on Mar. 25, 2022, as Appl. No. 17/704,920.
Claims priority of provisional application 63/200,880, filed on Mar. 31, 2021.
Prior Publication US 2022/0319229 A1, Oct. 6, 2022
Int. Cl. G06V 40/16 (2022.01); G06T 11/60 (2006.01); G06T 19/00 (2011.01); G06N 3/045 (2023.01)
CPC G06V 40/168 (2022.01) [G06N 3/045 (2023.01); G06T 11/60 (2013.01); G06T 19/006 (2013.01); G06T 2200/24 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method, comprising:
displaying, by one or more hardware processors, first augmented reality content on a computing device, the first augmented reality content comprising a first output media content, each frame of the first output media content including an image of a target face, the image of the target face being modified to mimic at least one of positions of a head of a source actor and at least one of facial expressions of the source actor in frames of a source media content;
providing for display, by the one or more hardware processors, a plurality of selectable graphical items, each of the selectable graphical items corresponding to a different augmented reality content including a set of media content modified utilizing facial synthesis;
receiving, by the one or more hardware processors, a selection of one of the plurality of selectable graphical items;
based at least in part on the selection, identifying, by the one or more hardware processors, second augmented reality content, the second augmented reality content comprising a second output media content, each frame of the second output media content including a second image of a second target face in at least one frame of the second output media content, the image of the second target face being modified to mimic at least one of positions of the head of the source actor and at least one of facial expressions of the source actor in frames of the source media content; and
providing, by the one or more hardware processors, the second augmented reality content for display on the computing device.