US 11,681,962 B2
Peer-review flagging system and methods for use therewith
Kevin Lyman, Fords, NJ (US); Anthony Upton, Malvern (AU); Li Yao, San Francisco, CA (US); and Ben Covington, Berkeley, CA (US)
Assigned to Enlitic, Inc., Fort Collins, CO (US)
Filed by Enlitic, Inc., San Francisco, CA (US)
Filed on Nov. 1, 2021, as Appl. No. 17/453,082.
Application 17/453,082 is a continuation of application No. 16/359,258, filed on Mar. 20, 2019, granted, now 11,200,969.
Claims priority of provisional application 62/770,334, filed on Nov. 21, 2018.
Prior Publication US 2022/0051768 A1, Feb. 17, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. G16H 15/00 (2018.01); G16H 30/20 (2018.01); G06Q 10/0631 (2023.01); G16H 10/60 (2018.01); G16H 30/40 (2018.01); G06T 5/00 (2006.01); G06T 5/50 (2006.01); G06T 7/00 (2017.01); G06T 11/00 (2006.01); G06N 5/04 (2023.01); G06N 20/00 (2019.01); G06F 9/54 (2006.01); G06T 7/187 (2017.01); G06T 7/11 (2017.01); G06F 3/0482 (2013.01); G06T 3/40 (2006.01); A61B 5/00 (2006.01); G16H 50/20 (2018.01); G06F 21/62 (2013.01); G06Q 20/14 (2012.01); G16H 40/20 (2018.01); G06F 3/0484 (2022.01); G16H 10/20 (2018.01); G06N 5/045 (2023.01); G06T 7/10 (2017.01); G06T 11/20 (2006.01); G06F 16/245 (2019.01); G06T 7/44 (2017.01); G06N 20/20 (2019.01); H04L 67/12 (2022.01); H04L 67/01 (2022.01); G06V 10/82 (2022.01); G06F 18/40 (2023.01); G06F 18/214 (2023.01); G06F 18/21 (2023.01); G06F 18/2115 (2023.01); G06F 18/2415 (2023.01); G06V 10/25 (2022.01); G06V 30/19 (2022.01); G06V 10/764 (2022.01); G06V 40/16 (2022.01); G06V 10/22 (2022.01); G16H 50/70 (2018.01); G06T 7/70 (2017.01); G16H 50/30 (2018.01); A61B 5/055 (2006.01); A61B 6/03 (2006.01); A61B 8/00 (2006.01); A61B 6/00 (2006.01); G06Q 50/22 (2018.01); G06F 40/295 (2020.01); G06F 18/24 (2023.01); G06F 18/2111 (2023.01); G06V 30/194 (2022.01)
CPC G06Q 10/06315 (2013.01) [A61B 5/7264 (2013.01); G06F 3/0482 (2013.01); G06F 3/0484 (2013.01); G06F 9/542 (2013.01); G06F 16/245 (2019.01); G06F 18/214 (2023.01); G06F 18/217 (2023.01); G06F 18/2115 (2023.01); G06F 18/2415 (2023.01); G06F 18/41 (2023.01); G06F 21/6254 (2013.01); G06N 5/04 (2013.01); G06N 5/045 (2013.01); G06N 20/00 (2019.01); G06N 20/20 (2019.01); G06Q 20/14 (2013.01); G06T 3/40 (2013.01); G06T 5/002 (2013.01); G06T 5/008 (2013.01); G06T 5/50 (2013.01); G06T 7/0012 (2013.01); G06T 7/0014 (2013.01); G06T 7/10 (2017.01); G06T 7/11 (2017.01); G06T 7/187 (2017.01); G06T 7/44 (2017.01); G06T 7/97 (2017.01); G06T 11/001 (2013.01); G06T 11/006 (2013.01); G06T 11/206 (2013.01); G06V 10/225 (2022.01); G06V 10/25 (2022.01); G06V 10/764 (2022.01); G06V 10/82 (2022.01); G06V 30/19173 (2022.01); G06V 40/171 (2022.01); G16H 10/20 (2018.01); G16H 10/60 (2018.01); G16H 15/00 (2018.01); G16H 30/20 (2018.01); G16H 30/40 (2018.01); G16H 40/20 (2018.01); G16H 50/20 (2018.01); H04L 67/01 (2022.05); H04L 67/12 (2013.01); A61B 5/055 (2013.01); A61B 6/032 (2013.01); A61B 6/5217 (2013.01); A61B 8/4416 (2013.01); G06F 18/2111 (2023.01); G06F 18/24 (2023.01); G06F 40/295 (2020.01); G06Q 50/22 (2013.01); G06T 7/70 (2017.01); G06T 2200/24 (2013.01); G06T 2207/10048 (2013.01); G06T 2207/10081 (2013.01); G06T 2207/10088 (2013.01); G06T 2207/10116 (2013.01); G06T 2207/10132 (2013.01); G06T 2207/20076 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/30004 (2013.01); G06T 2207/30008 (2013.01); G06T 2207/30016 (2013.01); G06T 2207/30061 (2013.01); G06V 30/194 (2022.01); G06V 2201/03 (2022.01); G16H 50/30 (2018.01); G16H 50/70 (2018.01)] 20 Claims
OG exemplary drawing
 
1. A peer-review flagging system, comprising:
at least one processor; and
a memory that stores operational instructions that, when executed by the at least one processor, cause the peer-review flagging system to:
train a computer vision model from a training set of medical scans by utilizing artificial intelligence;
generate first automated assessment data via artificial intelligence by performing a first inference function on a first medical scan by utilizing the computer vision model;
generate first human assessment data by performing an extraction function on a first medical report written by a first medical professional in conjunction with review of the first medical scan;
generate first consensus data by performing a consensus function on the first automated assessment data and the first human assessment data, wherein performing the consensus function includes calculating a first consensus score by comparing the first automated assessment data to the first human assessment data, and further includes comparing the first consensus score to a first threshold;
determine to flag the first medical scan for peer-review based on the first consensus data;
transmit a peer-review notification based on determining to flag the first medical scan for peer-review;
select a second threshold for use in generating second consensus data for a second medical scan and a second medical report written by the first medical professional in conjunction with review of the second medical scan, wherein the second threshold is selected to be stricter than the first threshold based on determining to flag the first medical scan for peer-review;
generate second automated assessment data via artificial intelligence by performing the first inference function on the second medical scan by utilizing the computer vision model;
generate second human assessment data by performing the extraction function on the second medical report;
generate the second consensus data by performing the consensus function on the second automated assessment data and the second human assessment data, wherein performing the consensus function includes calculating a second consensus score by comparing the second automated assessment data to the second human assessment data, and further includes comparing the second consensus score to the second threshold; and
determine whether to flag the second medical scan for peer-review based on the second consensus data.