US 7,590,287 B2
Method for generating a quality oriented significance map for assessing the quality of an image or video
Zhongkang Lu, Singapore (Singapore); Weisi Lin, Singapore (Singapore); Susu Yao, Singapore (Singapore); and Ee Ping Ong, Singapore (Singapore)
Assigned to Agency for Science, Technology and Research, Singapore (Singapore)
Appl. No. 10/534,415
PCT Filed Nov. 06, 2002, PCT No. PCT/SG02/00259
§ 371(c)(1), (2), (4) Date Mar. 09, 2006,
PCT Pub. No. WO2004/043054, PCT Pub. Date May 21, 2004.
Prior Publication US 2006/0233442 A1, Oct. 19, 2006
Int. Cl. G06K 9/46 (2006.01)
U.S. Cl. 382—190 10 Claims
OG exemplary drawing
 
1. A method for generating a quality oriented significance map for assessing the quality of an image or video, comprising the following steps:
extracting features of the image or video using visual feature-based information and knowledge-based information;
determining a perceptual quality requirement of at least one extracted feature; and
integrating the extracted features and the perceptual quality requirement of the at least one extracted feature to form an array of significance level values using a nonlinear mapping function, thereby generating the quality oriented significance map;
wherein coupling effects as a result of the integration of the extracted features are used when forming the array of the significance level values, and wherein the quality oriented significance map is obtained using the following equation:

OG Complex Work Unit Drawing
wherein
ms,i,j,t is an element of the quality oriented significance map at scale s, position (i, j) and time t;
fs,i,j,tn is the nth extracted feature,
cLk is a coupling factor which denotes the coupling effects of combining fs,i,j,tL and fs,i,j,tk;
n is the index extracted feature;
k is another index of extracted feature such that 1<k<N and k≠L;
N is the total number of extracted features;
L is the maximum value of fs,i,j,tn denoted as
L=arg max(fs,i,j,tn),
g1 is the nonlinear mapping function.