US 11,810,138 B2
System, method, and computer program product for determining a control account that corresponds to an exposed account
William J. Burton, Burlingame, CA (US); Tanya Soluk, San Carlos, CA (US); Qingyuan Zhang, Los Altos, CA (US); Jingjing Zhang, Redwood City, CA (US); Bingxin Mao, Shanghai (CN); Jiaqi Xu, Foster City, CA (US); and Linjun Chen, San Jose, CA (US)
Assigned to Visa International Service Association, San Francisco, CA (US)
Filed by Visa International Service Association, San Francisco, CA (US)
Filed on Mar. 2, 2022, as Appl. No. 17/684,483.
Application 17/684,483 is a continuation of application No. 16/820,074, filed on Mar. 16, 2020, granted, now 11,301,886.
Claims priority of provisional application 62/818,939, filed on Mar. 15, 2019.
Prior Publication US 2022/0188849 A1, Jun. 16, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. G06Q 30/0204 (2023.01); G06F 16/245 (2019.01); G06Q 40/02 (2023.01); G06N 5/04 (2023.01); G06Q 30/0226 (2023.01); G06N 20/00 (2019.01)
CPC G06Q 30/0204 (2013.01) [G06F 16/245 (2019.01); G06N 5/04 (2013.01); G06Q 40/02 (2013.01); G06N 20/00 (2019.01); G06Q 30/0226 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A system, comprising:
at least one processor programmed or configured to:
determine a first cohort level group of accounts, wherein the first cohort level group of accounts comprises a group of exposed accounts and a group of control accounts that are associated with a first specified event time period of a plurality of event time periods, wherein each account of the group of exposed accounts is associated with an event time period of a plurality of event time periods, wherein each event time period of the plurality of event time periods is associated with a time period during which the account was exposed to an event associated with a merchant, wherein the event associated with the merchant is an offer associated with a loyalty program of the merchant or enrollment in the loyalty program of the merchant, and wherein each account of the group of control accounts were not exposed to the event associated with the merchant and conducted at least one transaction involving the merchant during at least one event time period of the plurality of event time periods;
determine a first segment level group of accounts from the first cohort level group of accounts based on an indication of whether each account of the first cohort level group of accounts is part of a validation segment of accounts or post-event segment of accounts and an indication of whether the account is an existing account or a new account;
generate a prediction model based on a plurality of control accounts that are included in the first segment level group of accounts, wherein the prediction model is configured to output a prediction score that represents an amount of spending involving an account after the first specified event time period during which the account was exposed to the event associated with the merchant, wherein, when generating the prediction model, the at least one processor is programmed or configured to:
determine a plurality of modeling variables for each account of the group of control accounts included in the first cohort level group of accounts, wherein the plurality of modeling variables comprises:
a number of transactions initiated using the account that involve the merchant during the first specified event time period;
determine a variable importance metric associated with each modeling variable of the plurality of modeling variables;
exclude one or more modeling variables of the plurality of modeling variables based on the variable importance metric associated with the one or more modeling variables of the plurality of modeling variables to provide a subset of modeling variables;
train the prediction model based on the subset of modeling variables;
calculate an error term based on training the prediction model; and
update one or more weights of the prediction model based on the error term;
identify a first exposed account of a plurality of exposed accounts that are included in the first segment level group of accounts; and
determine a first control account of the plurality of control accounts that are included in the first segment level group of accounts that corresponds to the first exposed account using the prediction model, wherein, when determining the first control account of the plurality of control accounts that are included in the first segment level group of accounts that corresponds to the first exposed account using the prediction model, the at least one processor is programmed or configured to:
determine the first control account of the plurality of control accounts that are included in the first segment level group of accounts that corresponds to the first exposed account based on a prediction score for the first control account and a prediction score for the first exposed account provided by the prediction model.