CPC G06V 40/174 (2022.01) [G06F 18/214 (2023.01); G06N 3/08 (2013.01); G06V 40/171 (2022.01)] | 27 Claims |
1. An apparatus for facial expression recognition, the apparatus comprising:
a memory; and
one or more processors coupled to the memory, the one or more processors being configured to:
receive an image frame corresponding to a face of a person;
determine, based on a three-dimensional model of the face, landmark feature information associated with landmark features of the face, wherein the landmark feature information includes one or more blendshape coefficients determined based on the three-dimensional model;
input, to at least one layer of a neural network trained for facial expression recognition, the image frame and the landmark feature information;
determine, using the neural network, a facial expression associated with the face;
generate the three-dimensional model of the face; and
determine the one or more blendshape coefficients based on a comparison between the three-dimensional model of the face and image data corresponding to the face within the image frame.
|