US 11,816,821 B2
Method and system for generating an enriched image of a target object and corresponding computer program and computer-readable storage medium
Marcus Pfister, Bubenreuth (DE)
Assigned to Siemens Healthcare GmbH, Erlangen (DE)
Filed by Siemens Healthcare GmbH, Erlangen (DE)
Filed on Jul. 24, 2020, as Appl. No. 16/937,831.
Claims priority of application No. 102019211526.8 (DE), filed on Aug. 1, 2019.
Prior Publication US 2021/0035274 A1, Feb. 4, 2021
Int. Cl. G06V 10/77 (2022.01); G06T 5/50 (2006.01); G06F 3/01 (2006.01); G06N 3/02 (2006.01); G06F 18/24 (2023.01); G06V 10/80 (2022.01)
CPC G06T 5/50 (2013.01) [G06F 3/014 (2013.01); G06F 3/016 (2013.01); G06F 18/24 (2023.01); G06N 3/02 (2013.01); G06V 10/80 (2022.01); G06T 2207/20221 (2013.01)] 16 Claims
OG exemplary drawing
 
1. A method for generating an enriched image, the method comprising:
acquiring image data of a target object, the image data recorded by an imaging modality;
acquiring tactile data for the target object by a sensor device comprising at least one sensor integrated in at least one fingertip region of the sensor device, wherein the tactile data characterizes a mechanical resistance of at least one section of the target object against a force applied to the target object;
automatically spatially tracking the at least one sensor while the at least one sensor is recording the tactile data;
automatically assigning a respective recording location to the tactile data based on the automatic spatial tracking, wherein the tactile data is annotated with a respective position and respective coordinates, and wherein an actual measurement of the at least one sensor and the respective position or the respective coordinates are in a form of two data sets, which are each provided with time stamps; and
generating the enriched image by merging the image data with the tactile data and/or a classification derived from the tactile data of the at least one section of the target object,
wherein, in order to merge the image data with the tactile data, the image data and the tactile data are registered with each other using a coordinate system.