Share Email Print

Proceedings Paper

Supplemental subjective testing to evaluate the performance of image and video quality estimators
Author(s): Frank M. Ciaramello; Amy R. Reibman
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

The subjective tests used to evaluate image and video quality estimators (QEs) are expensive and time consuming. More problematic, the majority of subjective testing is not designed to find systematic weaknesses in the evaluated QEs. As a result, a motivated attacker can take advantage of these systematic weaknesses to gain unfair monetary advantage. In this paper, we draw on some lessons of software testing to propose additional testing procedures that target a specific QE under test. These procedures supplement, but do not replace, the traditional subjective testing procedures that are currently used. The goal is to motivate the design of objective QEs which are better able to accurately characterize human quality assessment.

Paper Details

Date Published: 2 February 2011
PDF: 9 pages
Proc. SPIE 7865, Human Vision and Electronic Imaging XVI, 78650Q (2 February 2011); doi: 10.1117/12.876747
Show Author Affiliations
Frank M. Ciaramello, Cornell Univ. (United States)
Amy R. Reibman, AT&T Labs. Research (United States)

Published in SPIE Proceedings Vol. 7865:
Human Vision and Electronic Imaging XVI
Bernice E. Rogowitz; Thrasyvoulos N. Pappas, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?