US 9,811,947 B2
System and method of markerless injection of ads in AR
Yousuf Chowdhary, Maple (CA); Kevin Garland, Toronto (CA); and Steven Blumenfeld, Lafayette, CA (US)
Assigned to Civic Resource Group International Inc., Los Angeles, CA (US)
Filed by GLOBALIVE XMG JV INC., Toronto (CA)
Filed on Aug. 4, 2016, as Appl. No. 15/229,066.
Claims priority of provisional application 62/201,205, filed on Aug. 5, 2015.
Prior Publication US 2017/0039771 A1, Feb. 9, 2017
Int. Cl. G09G 5/00 (2006.01); G06T 19/00 (2011.01); G06T 7/40 (2017.01); G06F 3/01 (2006.01); G06Q 30/02 (2012.01); G06T 7/90 (2017.01)
CPC G06T 19/006 (2013.01) [G06F 3/016 (2013.01); G06Q 30/0277 (2013.01); G06T 7/40 (2013.01); G06T 7/90 (2017.01); G06T 2207/30244 (2013.01)] 15 Claims
OG exemplary drawing
 
1. A method of markerless injection of content into an augmented reality scene by use of a mobile device, comprising:
through the mobile device, acquiring a camera feed of a scene, the scene including a flat surface;
selecting a key frame of the flat surface from the feed;
determining that the flat surface in the key frame meets a predetermined level of feature richness; and
injecting digital content by superimposing text, graphics, video content over at least a part of the key frame, and allowing the digital content to be viewed and interacted with by the user of the mobile device,
wherein injecting digital content further comprises:
using an optical flow to detect changes in features of the flat surface;
generating a homography matrix;
decomposing the homography matrix into two ambiguous cases;
using knowledge of the normal of the plane to disambiguate the cases and select one correct one; and
calculating a pose estimation for the camera relative to the flat feature rich surface after disambiguation in order to inject the digital content by superimposing it on the flat surface.