Share Email Print

Proceedings Paper

Anatomy segmentation evaluation with sparse ground truth data
Author(s): Jieyu Li; Jayaram K. Udupa; Yubing Tong; Lisheng Wang; Drew A. Torigian
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

The performance and evaluation of segmentation algorithms will benefit from large fully annotated data sets, but the heavy workload of manual contouring is unrealistic in clinical and research practice. In this work, we propose a method of automatically creating pseudo ground truth (p-GT) segmentations of anatomical objects from given sparse manually annotated slices and utilize them to evaluate actual segmentations. Sparse slices are selected spatially evenly on the whole slice range of the target object, where one slice is selected to conduct manual annotation and the next t slices are skipped, repeating this process starting from one end of the object to its other end. A shape-based interpolation (SI) strategy and an object-specific 2D U-net based deep learning (DL) strategy are investigated to create p-GT. The largest t value where the created p-GT is considered to be not statistically significantly different from the actual ground with its natural imprecision due to variability in manually specified ground truth is determined as the optimal t for the considered object. Experiments are conducted on ~300 computed tomography (CT) studies involving two objects – cervical esophagus and mandible and two segmentation evaluation metrics – Dice Coefficient and average symmetric boundary distance. Results show that the DL strategy overwhelmingly outperforms the SI strategy, where ~95% and ~66-83% of manual workload can be reduced without sacrificing evaluation accuracy compared to actual ground truth data via the DL and SI strategies respectively. Furthermore, the p-GT with optimal t is able to evaluate actual segmentations with accurate metric values.

Paper Details

Date Published: 10 March 2020
PDF: 11 pages
Proc. SPIE 11313, Medical Imaging 2020: Image Processing, 113131G (10 March 2020); doi: 10.1117/12.2549327
Show Author Affiliations
Jieyu Li, Shanghai Jiao Tong Univ. (China)
Univ. of Pennsylvania (United States)
Jayaram K. Udupa, Univ. of Pennsylvania (United States)
Yubing Tong, Univ. of Pennsylvania (United States)
Lisheng Wang, Shanghai Jiao Tong Univ. (China)
Drew A. Torigian, Univ. of Pennsylvania (United States)

Published in SPIE Proceedings Vol. 11313:
Medical Imaging 2020: Image Processing
Ivana Išgum; Bennett A. Landman, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?