US 11,704,567 B2
Systems and methods for an accelerated tuning of hyperparameters of a model using a machine learning-based tuning service
Michael McCourt, San Francisco, CA (US); Ben Hsu, San Francisco, CA (US); Patrick Hayes, San Francisco, CA (US); and Scott Clark, San Francisco, CA (US)
Assigned to Intel Corporation, Santa Clara, CA (US)
Filed by Intel Corporation, Santa Clara, CA (US)
Filed on Jul. 15, 2019, as Appl. No. 16/511,320.
Claims priority of provisional application 62/697,578, filed on Jul. 13, 2018.
Prior Publication US 2020/0019888 A1, Jan. 16, 2020
Int. Cl. G06N 3/082 (2023.01); G06N 20/00 (2019.01); G06N 20/20 (2019.01)
CPC G06N 3/082 (2013.01) [G06N 20/00 (2019.01); G06N 20/20 (2019.01)] 16 Claims
OG exemplary drawing
 
1. A system to accelerate tuning of hyperparameters, the system comprising:
memory;
programmable circuitry; and
instructions in the memory to cause the programmable circuitry to:
access a multi-task tuning work request to tune hyperparameters of a model of a subscriber to a tuning service, the multi-task tuning work request to include:
(i) a full tuning task to tune the hyperparameters of the model, the full tuning task to include first tuning parameters governing a first tuning operation of the tuning service; and
(ii) a partial tuning task to tune the hyperparameters of the model, the partial tuning task to include second tuning parameters governing a second tuning operation of the tuning service;
during the first tuning operation, provide as input to tune the model a corpus of training data based on one or more of the first tuning parameters of the full tuning task;
execute the first tuning operation of the full tuning task based on the first tuning parameters;
during the second tuning operation, sample a subset of the corpus of training data as input to tune the model based on one or more of the second tuning parameters of the partial tuning task;
execute the second tuning operation of the partial tuning task based on the second tuning parameters;
generate a first suggestion set, the first suggestion set to include one or more first proposed values for the hyperparameters based on the execution of the full tuning task; and
generate a second suggestion set, the second suggestion set to include one or more second proposed values for the hyperparameters based on the execution of the partial tuning task,
wherein after an identified performance metric of the model using the one or more second proposed values for the hyperparameters corresponding to the partial tuning task satisfies a performance threshold, set the partial tuning task as a proxy for the full tuning task to accelerate tuning of the hyperparameters of the model.