Share Email Print

Proceedings Paper

Methodology for evaluating image-segmentation algorithms
Author(s): Jayaram K. Udupa; Vicki R. LaBlanc; Hilary Schmidt; Celina Imielinska; Punam K. Saha; George J. Grevera; Ying Zhuge; L. M. Currie; Pat Molholt; Yinpeng Jin
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

The purpose of this paper is to describe a framework for evaluating image segmentation algorithms. Image segmentation consists of object recognition and delineation. For evaluating segmentation methods, three factors - precision (reproducibility), accuracy (agreement with truth, validity), and efficiency (time taken) - need to be considered for both recognition and delineation. To assess precision, we need to choose a figure of merit, repeat segmentation considering all sources of variation, and determine variations in figure of merit via statistical analysis. It is impossible usually to establish true segmentation. Hence, to assess accuracy, we need to choose a surrogate of true segmentation and proceed as for precision. In determining accuracy, it may be important to consider different landmark areas of the structure to be segmented depending on the application. To assess efficiency, both the computational and the user time required for algorithm and operator training and for algorithm execution should be measured and analyzed. Precision, accuracy, and efficiency are interdependent. It is difficult to improve one factor without affecting others. Segmentation methods must be compared based on all three factors. The weight given to each factor depends on application.

Paper Details

Date Published: 9 May 2002
PDF: 12 pages
Proc. SPIE 4684, Medical Imaging 2002: Image Processing, (9 May 2002); doi: 10.1117/12.467166
Show Author Affiliations
Jayaram K. Udupa, Univ. of Pennsylvania (United States)
Vicki R. LaBlanc, Columbia Univ. (United States)
Hilary Schmidt, Columbia Univ. (United States)
Celina Imielinska, Columbia Univ. (United States)
Punam K. Saha, Univ. of Pennsylvania (United States)
George J. Grevera, Univ. of Pennsylvania (United States)
Ying Zhuge, Univ. of Pennsylvania (United States)
L. M. Currie, Columbia Univ. (United States)
Pat Molholt, Columbia Univ. (United States)
Yinpeng Jin, Columbia Univ. (United States)

Published in SPIE Proceedings Vol. 4684:
Medical Imaging 2002: Image Processing
Milan Sonka; J. Michael Fitzpatrick, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?