US 11,755,641 B2
Image searches based on word vectors and image vectors
Jenhao Hsiao, Palo Alto, CA (US)
Assigned to GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
Filed by GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD., Dongguan (CN)
Filed on Jan. 13, 2022, as Appl. No. 17/575,209.
Application 17/575,209 is a continuation of application No. PCT/CN2020/091055, filed on May 19, 2020.
Claims priority of provisional application 62/895,309, filed on Sep. 3, 2019.
Prior Publication US 2022/0138252 A1, May 5, 2022
Int. Cl. G06F 16/00 (2019.01); G06F 16/583 (2019.01); G06F 16/53 (2019.01); G06F 16/538 (2019.01); G06F 16/56 (2019.01)
CPC G06F 16/5846 (2019.01) [G06F 16/53 (2019.01); G06F 16/538 (2019.01); G06F 16/56 (2019.01)] 18 Claims
OG exemplary drawing
 
1. A system comprising:
one or more processors; and
one or more memories storing instructions that, upon execution by at least one of the one or more processors, cause the system to perform operations including:
generating an image vector from an image based on an artificial model;
generating a first word vector from the image vector based on the artificial model;
receiving a query associated with an image search;
generating, based on the artificial model, a second word vector from text associated with the query;
determining a match between the first word vector and the second word vector; and
generating, based on the match, a search result that identifies the image;
wherein the operations further include training the artificial model by at least:
generating, based on the artificial model, a third word vector from a label associated with a training image;
generating, based on the artificial model, a second image vector from the training image;
generating, based on the artificial model, a first predicted word vector from the second image vector;
computing a loss of the artificial model based on the third word vector and the first predicted word vector; and
updating a parameter of the artificial model based on the loss.