CPC G06F 16/5846 (2019.01) [G06F 16/53 (2019.01); G06F 16/538 (2019.01); G06F 16/56 (2019.01)] | 18 Claims |
1. A system comprising:
one or more processors; and
one or more memories storing instructions that, upon execution by at least one of the one or more processors, cause the system to perform operations including:
generating an image vector from an image based on an artificial model;
generating a first word vector from the image vector based on the artificial model;
receiving a query associated with an image search;
generating, based on the artificial model, a second word vector from text associated with the query;
determining a match between the first word vector and the second word vector; and
generating, based on the match, a search result that identifies the image;
wherein the operations further include training the artificial model by at least:
generating, based on the artificial model, a third word vector from a label associated with a training image;
generating, based on the artificial model, a second image vector from the training image;
generating, based on the artificial model, a first predicted word vector from the second image vector;
computing a loss of the artificial model based on the third word vector and the first predicted word vector; and
updating a parameter of the artificial model based on the loss.
|