Share Email Print

Journal of Electronic Imaging

Psychophysical experiments on the PicHunter image retrieval system
Author(s): Thomas V. Papathomas; Ingemar J. Cox; Peter N. Yianilos; Matt L. Miller; Thomas P. Minka; Tiffany E. Conway; Joumana Ghosn
Format Member Price Non-Member Price
PDF $20.00 $25.00

Paper Abstract

Psychophysical experiments were conducted on PicHunter, a content-based image retrieval (CBIR) experimental prototype with the following properties: (1) Based on a model of how users respond, it uses Bayes’s rule to predict what target users want, given their actions. (2) It possesses an extremely simple user interface. (3) It employs an entropy-based scheme to improve convergence. (4) It introduces a paradigm for assessing the performance of CBIR systems. Experiments 1–3 studied human judgment of image similarity to obtain data for the model. Experiment 4 studied the importance of using: (a) semantic information, (b) memory of earlier input, and (c) relative and absolute judgments of similarity. Experiment 5 tested an approach that we propose for comparing performances of CBIR systems objectively. Finally, experiment 6 evaluated the most informative display-updating scheme that is based on entropy minimization, and confirmed earlier simulation results. These experiments represent one of the first attempts to quantify CBIR performance based on psychophysical studies, and they provide valuable data for improving CBIR algorithms. Even though they were designed with PicHunter in mind, their results can be applied to any CBIR system and, more generally, to any system that involves judgment of image similarity by humans.

Paper Details

Date Published: 1 January 2001
PDF: 11 pages
J. Electron. Imag. 10(1) doi: 10.1117/1.1333058
Published in: Journal of Electronic Imaging Volume 10, Issue 1
Show Author Affiliations
Thomas V. Papathomas, Rutgers Univ. (United States)
Ingemar J. Cox, NEC Research Institute (United States)
Peter N. Yianilos, NEC Research Institute (United States)
Matt L. Miller, NEC Research Inst. (United States)
Thomas P. Minka, Massachusetts Institute of Technology (United States)
Tiffany E. Conway, Rutgers Univ. (United States)
Joumana Ghosn, Univ. de Montreal (Canada)

© SPIE. Terms of Use
Back to Top