Registration is open - make plans to attend
Get pricing and details
>
Conference 12035 > Paper 12035-29
Paper 12035-29

Is this good enough? On expert perception of brain tumor segmentation quality

In person: 21 February 2022 • 11:10 AM - 11:30 AM PST

Abstract

Metrics routinely used to evaluate the performance of Deep Learning (DL) segmentation algorithms show a low concordance with human segmentation quality perception. Here, we present the results of a study on expert quality perception of brain tumor segmentations generated by a DL segmentation algorithm. The quality of 60 segmentations was rated by four expert medical professionals. We observed a low inter-rater agreement among all raters and varying levels of pairwise agreement between raters. The highest correlation between selected segmentation quality metrics and ratings could be observed for Hausdorff distance with a high variability in the correlations of individual raters.

Presenter

Athinoula A. Martinos Ctr. for Biomedical Imaging (United States)
Katharina is a medical doctor and Ph.D. candidate in Medical Engineering and Medical Physics at the Harvard-MIT Division of Health Science. She is working with Prof. Jayashree Kalpathy-Cramer in the Quantitative Translational Imaging in Medicine lab at the MGH Martinos Center for Biomedical Imaging and is passionate to improve the collaboration between health care professionals and AI through her research.
Presenter/Author
Athinoula A. Martinos Ctr. for Biomedical Imaging (United States)
Author
Athinoula A. Martinos Ctr. for Biomedical Imaging (United States), Massachusetts General Hospital (United States), BWH Ctr. for Clinical Data Science (United States)
Author
The Univ. of Texas M.D. Anderson Cancer Ctr. (United States)
Author
Massachusetts General Hospital (United States)
Author
Caroline Chung M.D.
The Univ. of Texas M.D. Anderson Cancer Ctr. (United States)
Author
Brigham and Women's Hospital, Harvard Medical School (United States)
Author
The Univ. of Texas M.D. Anderson Cancer Ctr. (United States)
Author
Athinoula A. Martinos Ctr. for Biomedical Imaging (United States)
Author
Athinoula A. Martinos Ctr. for Biomedical Imaging (United States)
Author
Athinoula A. Martinos Ctr. for Biomedical Imaging (United States)
Author
Athinoula A. Martinos Ctr. for Biomedical Imaging (United States)
Author
The Univ. of Texas Southwestern Medical Ctr. at Dallas (United States)
Author
Massachusetts General Hospital (United States)
Author
Athinoula A. Martinos Ctr. for Biomedical Imaging (United States)
Author
Athinoula A. Martinos Ctr. for Biomedical Imaging (United States)
Author
Athinoula A. Martinos Ctr. for Biomedical Imaging (United States)