Share Email Print

Journal of Electronic Imaging

Scene reduction for subjective image quality assessment
Author(s): Anna Lewandowska Tomaszewska
Format Member Price Non-Member Price
PDF $20.00 $25.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

Evaluation of image quality is important for many image processing systems, such as those used for acquisition, compression, restoration, enhancement, or reproduction. Its measurement is often accompanied by user studies, in which a group of observers rank or rate results of several algorithms. Such user studies, known as subjective image quality assessment experiments, can be very time consuming and do not guarantee conclusive results. This paper is intended to help design an efficient and rigorous quality assessment experiment. We propose a method of limiting the number of scenes that need to be tested, which can significantly reduce the experimental effort and still capture relevant scene-dependent effects. To achieve it, we employ a clustering technique and evaluate it on the basis of compactness and separation criteria. The correlation between the results obtained from a set of images in an initial database and the results received from reduced experiment are analyzed. Finally, we propose a procedure for reducing the initial scenes number. Four different assessment techniques were tested: single stimulus, double stimulus, forced choice, and similarity judgments. We conclude that in most cases, 9 to 12 judgments per evaluated algorithm for a large scene collection is sufficient to reduce the initial set of images.

Paper Details

Date Published: 25 January 2016
PDF: 13 pages
J. Electron. Imag. 25(1) 013015 doi: 10.1117/1.JEI.25.1.013015
Published in: Journal of Electronic Imaging Volume 25, Issue 1
Show Author Affiliations
Anna Lewandowska Tomaszewska, West Pomeranian Univ. of Technology Szczecin (Poland)

© SPIE. Terms of Use
Back to Top