Share Email Print

Journal of Electronic Imaging

Comparative study of localization metrics for the evaluation of image interpretation systems
Author(s): Baptiste Hemery; Helene Laurent; Bruno Emile; Christophe Rosenberger
Format Member Price Non-Member Price
PDF $20.00 $25.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

Image interpretation is particularly important in many real applications (video monitoring, biometrics, etc.). Due to the proliferation of image interpretation systems in the literature, their evaluation still remains a crucial stake. Among all the tasks in this field, the quality of object localization is often evaluated through an evaluation metric. We propose to review these techniques and study their reliability. We first propose a generic definition of a localization algorithm. Then, different state of the art techniques to evaluate image interpretation results are detailed. Secondly, we focus on metrics that enable us to evaluate localization results. We propose a general methodology to analyze the behavior of an evaluation metric, considered here as a black box (its definition is not even supposed to be known). We define the properties that these metrics should fulfill. We then perform a comparative study of 33 localization metrics from the state of the art. Experimental results conducted on a large and significant image database permit us to determine metrics that should be used in the future for the evaluation of object localization results.

Paper Details

Date Published: 1 April 2010
PDF: 21 pages
J. Electron. Imag. 19(2) 023017 doi: 10.1117/1.3446803
Published in: Journal of Electronic Imaging Volume 19, Issue 2
Show Author Affiliations
Baptiste Hemery, ENSICAEN (France)
Helene Laurent, Univ. d'Orléans (France)
Bruno Emile, Univ. d'Orléans (France)
Christophe Rosenberger, ENSICAEN (France)

© SPIE. Terms of Use
Back to Top