US 11,706,374 B2
Methods and apparatus for re-timing and scaling input video tracks
Xin Wang, San Jose, CA (US); and Lulin Chen, San Jose, CA (US)
Assigned to MEDIATEK Singapore Pte. Ltd., Singapore (SG)
Filed by MEDIATEK Singapore Pte. Ltd., Singapore (SG)
Filed on Apr. 9, 2021, as Appl. No. 17/226,823.
Claims priority of provisional application 63/008,976, filed on Apr. 13, 2020.
Prior Publication US 2021/0321019 A1, Oct. 14, 2021
Int. Cl. H04N 5/05 (2006.01); H04N 21/435 (2011.01); H04N 21/81 (2011.01); H04N 21/236 (2011.01); H04N 9/82 (2006.01)
CPC H04N 5/05 (2013.01) [H04N 9/8205 (2013.01); H04N 21/23608 (2013.01); H04N 21/435 (2013.01); H04N 21/816 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method implemented by at least one processor in communication with a memory, wherein the memory stores computer-readable instructions that, when executed by the at least one processor, cause the at least one processor to perform:
accessing multimedia data comprising a hierarchical track structure comprising at least:
a first track at a first level of the hierarchical track structure comprising first media data, wherein the first media data comprises a first sequence of video media units; and
a second track at a second level in the hierarchical track structure that is different than the first level of the first track, the second track comprising metadata specifying a re-timing derivation operation and not any of the video media units from the first sequence of video media units; and
generating output video media units according to the second track, comprising performing the re-timing derivation operation on the first sequence of video media units to modify a timing of the first sequence of video media units by one or more of: (a) removing one or more video media units associated with the re-timing derivation operation, (b) shifting timing information of the first sequence of video media units, (c) skipping one or more video media units associated with the re-timing derivation operation and (d) inserting one or more video media units associated with the re-timing derivation operation.