| US 7,570,813 B2 | ||
| Strokes localization by m-array decoding and fast image matching | ||
| Jian Wang, Beijing (China); Yingnong Dang, Beijing (China); Qiang Wang, Beijing (China); Liyong Chen, Beijing (China); and Xiaoxu Ma, Cambridge, Mass. (US) | ||
| Assigned to Microsoft Corporation, Redmond, Wash. (US) | ||
| Filed on Aug. 27, 2007, as Appl. No. 11/845,584. | ||
| Application 11/845584 is a continuation of application No. 10/759357, filed on Jan. 16, 2004, granted, now 7,263,224, filed on Aug. 28, 2007. | ||
| Prior Publication US 2008/0025612 A1, Jan. 31, 2008 | ||
| This patent is subject to a terminal disclaimer. | ||
| Int. Cl. G06K 9/00 (2006.01) | ||
| U.S. Cl. 382—188 [345/179; 382/100] | 14 Claims |

| 1. A method for determining a path of a pen tip of a pen within a document, the method comprising:
(A) calibrating the pen in order to obtain a calibration parameter;
(B) analyzing a watermarked document image in order to determine areas where x-y positions cannot be uniquely determined by
m-array decoding;
(C) segmenting a maze pattern from an obstruction component of a captured image, wherein the obstruction component comprises
document content that occludes the maze pattern;
(D) analyzing the maze pattern to extract bits from the maze pattern of the captured image;
(E) in response to (D), determining a transform that transforms image position coordinates to actual position coordinates,
wherein the actual position coordinates identify a location of the pen tip in relation to the document;
(F) decoding the extracted bits associated with the captured image;
(G) in response to (F), if the image position coordinates of the captured image cannot be determined, matching the captured
image with image information, comprising:
(i) warping the captured image to create a warped image; and
(ii) matching the warped image with an area of the document, where a corresponding x-y position cannot be uniquely determined
by m-array decoding;
(H) determining image position coordinates of other image frames that are associated with a pen stroke, comprising:
(i) matching a corresponding captured image with a neighboring area of the image position coordinates of an image whose image
position coordinates have been determined previously; and
(ii) repeating (i) until all image frames of the pen stroke are processed; and
(I) mapping the path of the pen tip from the transform, the calibration parameter, and the image position coordinates.
|