CPC G06V 20/49 (2022.01) [G06T 7/0012 (2013.01); G06T 2207/10016 (2013.01); G06T 2207/10068 (2013.01); G06T 2207/30204 (2013.01)] | 21 Claims |
1. A method for automatically segmenting surgical video data, the method comprising:
obtaining, by a computing device, video data for a surgical procedure from a camera configured to capture the video data, wherein the video data comprises a field of view of an anatomical region of a patient during the surgical procedure;
generating, by the computing device, a first video data stream and a second video data stream;
applying, by an AI processing unit associated with the computing device, one or more machine learning models to the second video data stream;
identifying, by the AI processing unit, one or more segments of the second video data stream based on the machine learning models; and
generating, by the AI processing unit, a set of tags associated with the one or more segments of the second video data stream;
wherein identifying the one or more segments of the second video data stream further comprises:
analyzing, by the AI processing unit, each of a plurality of frames in the second video data stream;
determining, by the AI processing unit, one or more features present within each of the plurality of frames in the second video data stream based on the machine learning models; and
identifying, by the AI processing unit, the one or more segments of the second video data stream by:
comparing, by the AI processing unit, each of the plurality of frames based on the one or more features present with a previous one of the frames in the plurality of frames,
identifying, by the AI processing unit, a state change in one of the one or more features based on the comparing, and
identifying, by the AI processing unit, a new segment in the second video data stream based on the state change.
|