Share Email Print
cover

Proceedings Paper

Subjective testing methodology in MPEG video verification
Author(s): Charles Fenimore; Vittorio Baroncini; Tobias Oelbaum; Thiow Keng Tan
Format Member Price Non-Member Price
PDF $14.40 $18.00

Paper Abstract

The development of new video processing, new displays, and new modes of dissemination and usage enables a variety of moving picture applications intended for mobile and desktop devices as well as the more conventional platforms. These applications include multimedia as well as traditional video and require novel lighting environments and bit rates previously unplumbed in Moving Picture Experts Group (MPEG) video compression. The migration to new environments poses a methodological challenge to testers of video quality. Both the viewing environment and the display characteristics differ dramatically from those used in well-established subjective testing methods for television. The MPEG Test Committee has adapted the television-centric methodology to the new testing environments. The adaptations that are examined here include: (1) The display of progressive scan pictures in the Common Intermediate Format (CIF at 352x288 pixel/frame) and Quarter CIF (QCIF at 176x144 pixel/frame) as well as other, larger moving pictures requires new ways of testing the subjects including different viewing distances and altered ambient lighting. (2) The advent of new varieties of display technologies suggests there is a need for methods of characterizing them to assure the results of the testing do not depend strongly on the display. (3) The use of non-parametric statistical tests in test data analysis. In MPEG testing these appear to provide rigorous confidence statements more in line with testing experience than those provided by classical parametric tests. These issues have been addressed in a recent MPEG subjective test. Some of the test results are reviewed; they suggest that these adaptations of long-established subjective testing methodology for TV are capable of providing practical and reliable measures of subjective video quality for a new generation of technology.

Paper Details

Date Published: 2 November 2004
PDF: 9 pages
Proc. SPIE 5558, Applications of Digital Image Processing XXVII, (2 November 2004); doi: 10.1117/12.563519
Show Author Affiliations
Charles Fenimore, National Institute of Standards and Technology (United States)
Vittorio Baroncini, Fondazione Ugo Bordoni (Italy)
Tobias Oelbaum, Univ. of Technology Munich (Germany)
Thiow Keng Tan, NTT DoCoMo, Inc. (Japan)


Published in SPIE Proceedings Vol. 5558:
Applications of Digital Image Processing XXVII
Andrew G. Tescher, Editor(s)

© SPIE. Terms of Use
Back to Top