US 11,816,788 B2
Systems and methods for a generating an interactive 3D environment using virtual depth
Tamer Eskander, New York, NY (US); and Isaac Steele, New York, NY (US)
Assigned to VIACOM INTERNATIONAL INC., New York, NY (US)
Filed by VIACOM INTERNATIONAL INC., New York, NY (US)
Filed on Feb. 17, 2022, as Appl. No. 17/651,492.
Application 17/651,492 is a continuation of application No. 16/877,021, filed on May 18, 2020, granted, now 11,295,512.
Application 16/877,021 is a continuation of application No. 16/013,571, filed on Jun. 20, 2018, granted, now 10,699,474, issued on Jun. 30, 2020.
Application 16/013,571 is a continuation of application No. 15/233,823, filed on Aug. 10, 2016, granted, now 10,032,307, issued on Jul. 24, 2018.
Prior Publication US 2022/0172428 A1, Jun. 2, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 15/00 (2011.01); G06T 15/20 (2011.01); H04N 13/271 (2018.01); G11B 27/00 (2006.01)
CPC G06T 15/205 (2013.01) [G06T 15/00 (2013.01); G11B 27/00 (2013.01); H04N 13/271 (2018.05)] 16 Claims
OG exemplary drawing
 
1. A system for generating an interactive 3D environment, comprising:
a processing apparatus receiving a plurality of first frames, the processing apparatus being configured to extract from an analysis of the first frames, based on at least one of scene geometry, camera animation and objects animation, depth data related to the first frames and to construct based on the depth data an invisible three-dimensional (“3D”) framework for each of the first frames, the processing apparatus being configured to generate a plurality of second frames by inserting a virtual 3D object into the invisible 3D framework so that the virtual visible 3D object interacts with invisible objects defined by the invisible 3D framework, each of the second frames including a corresponding one of the first frames and at least a first one of the second frames including the virtual visible 3D object interacting with the invisible objects defined by the invisible 3D framework, wherein the processing apparatus is configured to adjust a trajectory of the virtual visible 3D object in the second frames based on interactions of the virtual visible 3D object with the invisible objects defined by the invisible 3D framework; and
a display displaying the second frames.