Share Email Print

Proceedings Paper

A novel adaptive scoring system for segmentation validation with multiple reference masks
Author(s): Jan Hendrik Moltz; Jan Rühaak; Horst Karl Hahn; Heinz-Otto Peitgen
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

The development of segmentation algorithms for different anatomical structures and imaging protocols is an important task in medical image processing. The validation of these methods, however, is often treated as a subordinate task. Since manual delineations, which are widely used as a surrogate for the ground truth, exhibit an inherent uncertainty, it is preferable to use multiple reference segmentations for an objective validation. This requires a consistent framework that should fulfill three criteria: 1) it should treat all reference masks equally a priori and not demand consensus between the experts; 2) it should evaluate the algorithmic performance in relation to the inter-reference variability, i.e., be more tolerant where the experts disagree about the true segmentation; 3) it should produce results that are comparable for different test data. We show why current state-of-the-art frameworks as the one used at several MICCAI segmentation challenges do not fulfill these criteria and propose a new validation methodology. A score is computed in an adaptive way for each individual segmentation problem, using a combination of volume- and surface-based comparison metrics. These are transformed into the score by relating them to the variability between the reference masks which can be measured by comparing the masks with each other or with an estimated ground truth. We present examples from a study on liver tumor segmentation in CT scans where our score shows a more adequate assessment of the segmentation results than the MICCAI framework.

Paper Details

Date Published: 11 March 2011
PDF: 10 pages
Proc. SPIE 7962, Medical Imaging 2011: Image Processing, 796214 (11 March 2011); doi: 10.1117/12.877813
Show Author Affiliations
Jan Hendrik Moltz, Fraunhofer MEVIS (Germany)
Jan Rühaak, Fraunhofer MEVIS (Germany)
Horst Karl Hahn, Fraunhofer MEVIS (Germany)
Heinz-Otto Peitgen, Fraunhofer MEVIS (Germany)

Published in SPIE Proceedings Vol. 7962:
Medical Imaging 2011: Image Processing
Benoit M. Dawant; David R. Haynor, Editor(s)

© SPIE. Terms of Use
Back to Top