US 9,813,707 B2
Data pruning for video compression using example-based super-resolution
Dong-Qing Zhang, Plainsboro, NJ (US); Sitaram Bhagavathy, Plainsboro, NJ (US); and Joan Llach, Cesson Sevigne (FR)
Assigned to THOMSON LICENSING DTV, Issy-les-Moulineaux (FR)
Appl. No. 13/522,024
Filed by Dong-Qing Zhang, Plainsboro, NJ (US); Sitaram Bhagavathy, Plainsboro, NJ (US); and Joan Llach, Cesson Sevigne (FR)
PCT Filed Jan. 21, 2011, PCT No. PCT/US2011/000117
§ 371(c)(1), (2), (4) Date Jul. 13, 2012,
PCT Pub. No. WO2011/090798, PCT Pub. Date Jul. 28, 2011.
Claims priority of provisional application 61/336,516, filed on Jan. 22, 2010.
Prior Publication US 2012/0288015 A1, Nov. 15, 2012
Int. Cl. H04N 7/12 (2006.01); H04N 19/105 (2014.01); H04N 7/54 (2006.01); H04N 19/146 (2014.01); H04N 19/152 (2014.01); H04N 19/149 (2014.01); H04N 19/154 (2014.01); H04N 7/01 (2006.01); H04N 19/139 (2014.01); H04N 19/46 (2014.01); H04N 19/14 (2014.01); H04N 19/94 (2014.01); H04N 19/59 (2014.01)
CPC H04N 19/105 (2014.11) [H04N 7/0125 (2013.01); H04N 7/54 (2013.01); H04N 19/139 (2014.11); H04N 19/14 (2014.11); H04N 19/146 (2014.11); H04N 19/149 (2014.11); H04N 19/152 (2014.11); H04N 19/154 (2014.11); H04N 19/46 (2014.11); H04N 19/59 (2014.11); H04N 19/94 (2014.11)] 40 Claims
OG exemplary drawing
1. A method of video processing, comprising:
extracting patches of video from a received video signal;
clustering the patches into groups, wherein clustering is performed by:
finding a cluster having a minimum distance between each data point and a cluster center;
comparing said minimum distance to a threshold, and if larger than the threshold the data point is rejected, otherwise the data point is assigned to the cluster; and
re-calculating a mean of the data points assigned to the cluster to determine an updated center of each cluster, after all data points are assigned, wherein frame identification and position of the patches within each cluster are retained;
downsizing the original video;
packing representative patches from the groups into patch frames at their corresponding positions;
assigning unassigned patches to empty blocks in the patch frames according to a metric based on neighboring blocks;
creating another patch frame if unassigned patches remain;
assigning a constant to additional empty blocks within a patch frame;
dividing patch frames by using a staggering sampling process; and
transmitting the downsized original video with the divided patch frames to a decoder.