US 11,817,129 B2
3D media elements in 2D video
Spencer Stephens, Los Angeles, CA (US); Royston Taylor, Los Angeles, CA (US); and Mark Turner, Los Angeles, CA (US)
Assigned to RYFF EUROPE LTD., Cambridge (GB)
Filed by Ryff Europe Ltd, Cambridge (GB)
Filed on Jun. 27, 2022, as Appl. No. 17/850,200.
Application 17/850,200 is a continuation of application No. 17/274,097, granted, now 11,404,089, previously published as PCT/US2019/050657, filed on Sep. 11, 2019.
Claims priority of provisional application 62/729,508, filed on Sep. 11, 2018.
Claims priority of provisional application 62/729,510, filed on Sep. 11, 2018.
Claims priority of provisional application 62/729,507, filed on Sep. 11, 2018.
Prior Publication US 2022/0328073 A1, Oct. 13, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. G11B 27/036 (2006.01); G06T 7/50 (2017.01); G06T 7/11 (2017.01); G06T 7/70 (2017.01); G06Q 30/06 (2023.01); G06T 19/00 (2011.01); H04L 9/32 (2006.01); G06V 20/40 (2022.01); G06Q 30/0601 (2023.01); G10L 25/57 (2013.01)
CPC G11B 27/036 (2013.01) [G06Q 30/0641 (2013.01); G06T 7/11 (2017.01); G06T 7/50 (2017.01); G06T 7/70 (2017.01); G06T 19/006 (2013.01); G06V 20/40 (2022.01); H04L 9/3247 (2013.01); G06T 2200/24 (2013.01); G06T 2207/10016 (2013.01); G06T 2207/20081 (2013.01); G10L 25/57 (2013.01)] 20 Claims
OG exemplary drawing
 
1. An apparatus for processing media content, the apparatus comprising:
at least one hardware processor;
at least one memory storing instructions that when executed cause the at least one hardware processor to perform operations comprising:
generating three-dimensional (3D) representations of media elements present in one or more two-dimensional (2D) images representing a 2D scene with the media content;
generating a 3D volume representation of the 2D scene based on aggregating the 3D representations;
segmenting a 3D void space associated with the 2D scene into a plurality of 3D void segments, the segmenting based on the 3D volume representation;
inserting a 3D media element into at least one 3D void segment of the plurality of 3D void segments; and
modifying the one or more 2D images to include the at least one 3D void segment with the 3D media element.