Share Email Print

Proceedings Paper

Tradeoffs in subjective testing methods for image and video quality assessment
Author(s): David M. Rouse; Romuald Pépion; Patrick Le Callet; Sheila S. Hemami
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

The merit of an objective quality estimator for either still images or video is gauged by its ability to accurately estimate the perceived quality scores of a collection of stimuli. Encounters with radically different distortion types that arise in novel media representations require that researchers collect perceived quality scores representative of these new distortions to confidently evaluate a candidate objective quality estimator. Two common methods used to collect perceived quality scores are absolute categorical rating (ACR)1 and subjective assessment for video quality (SAMVIQ).2, 3 The choice of a particular test method affects the accuracy and reliability of the data collected. An awareness of the potential benefits and/or costs attributed to the ACR and SAMVIQ test methods can guide researchers to choose the more suitable method for a particular application. This paper investigates the tradeoffs of these two subjective testing methods using three different subjective databases that have scores corresponding to each method. The subjective databases contain either still-images or video sequences. This paper has the following organization: Section 2 summarizes the two test methods compared in this paper, ACR and SAMVIQ. Section 3 summarizes the content of the three subjective databases used to evaluate the two test methods. An analysis of the ACR and SAMVIQ test methods is presented in Section 4. Section 5 concludes this paper.

Paper Details

Date Published: 17 February 2010
PDF: 11 pages
Proc. SPIE 7527, Human Vision and Electronic Imaging XV, 75270F (17 February 2010); doi: 10.1117/12.845389
Show Author Affiliations
David M. Rouse, Cornell Univ. (United States)
Romuald Pépion, Univ. de Nantes (France)
Patrick Le Callet, Univ. de Nantes (France)
Sheila S. Hemami, Cornell Univ. (United States)

Published in SPIE Proceedings Vol. 7527:
Human Vision and Electronic Imaging XV
Bernice E. Rogowitz; Thrasyvoulos N. Pappas, Editor(s)

© SPIE. Terms of Use
Back to Top