Share Email Print

Proceedings Paper

Comparing subjective image quality measurement methods for the creation of public databases
Author(s): Judith Redi; Hantao Liu; Hani Alers; Rodolfo Zunino; Ingrid Heynderickx
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

The Single Stimulus (SS) method is often chosen to collect subjective data testing no-reference objective metrics, as it is straightforward to implement and well standardized. At the same time, it exhibits some drawbacks; spread between different assessors is relatively large, and the measured ratings depend on the quality range spanned by the test samples, hence the results from different experiments cannot easily be merged . The Quality Ruler (QR) method has been proposed to overcome these inconveniences. This paper compares the performance of the SS and QR method for pictures impaired by Gaussian blur. The research goal is, on one hand, to analyze the advantages and disadvantages of both methods for quality assessment and, on the other, to make quality data of blur impaired images publicly available. The obtained results show that the confidence intervals of the QR scores are narrower than those of the SS scores. This indicates that the QR method enhances consistency across assessors. Moreover, QR scores exhibit a higher linear correlation with the distortion applied. In summary, for the purpose of building datasets of subjective quality, the QR approach seems promising from the viewpoint of both consistency and repeatability.

Paper Details

Date Published: 18 January 2010
PDF: 11 pages
Proc. SPIE 7529, Image Quality and System Performance VII, 752903 (18 January 2010); doi: 10.1117/12.839195
Show Author Affiliations
Judith Redi, Univ. of Genoa (Italy)
Hantao Liu, Delft Univ. of Technology (Netherlands)
Hani Alers, Delft Univ. of Technology (Netherlands)
Rodolfo Zunino, Univ. of Genoa (Italy)
Ingrid Heynderickx, Delft Univ. of Technology (Netherlands)
Philips Research Labs. (Netherlands)

Published in SPIE Proceedings Vol. 7529:
Image Quality and System Performance VII
Susan P. Farnand; Frans Gaykema, Editor(s)

© SPIE. Terms of Use
Back to Top