Share Email Print

Proceedings Paper

Comparison of free-response and ROC analyses in modality comparison studies involving lesion localization
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

It is possible that neglect of location information in lesion detection studies analyzed by the Receiver Operating Characteristic (ROC) method can compromise power. The Alternative Free-response ROC (AFROC) analysis considers the location information but its usage has been discouraged, since it neglects intra-image correlations. This study compared the statistical power of ROC and AFROC methodologies using simulations. A model including intra-image correlations was developed to describe the decision variable sampling and was used to simulate data for ROC and AFROC analysis. Five readers and 200 cases, half of which contained one signal, were simulated for each trial. Two hundred trials were run, equally split between the Null Hypothesis (NH) and the Alternative Hypothesis (AH). The ratings were analyzed by the Dorfman-Berbaum-Metz (DBM) method and the separation of the NH/AH distributions was calculated. It was found that the AFROC method yielded higher power than ROC. The separation of the NH and AH distributions were larger by a factor of 1.6, irrespective of the presence or absence of intra-image correlations. The effect of the incorrect localizations occurring in ROC analysis of localization data is believed to be the major reason for the enhanced power of the AFROC method, and greater use of AFROC methodology is warranted.

Paper Details

Date Published: 12 April 2002
PDF: 9 pages
Proc. SPIE 4686, Medical Imaging 2002: Image Perception, Observer Performance, and Technology Assessment, (12 April 2002); doi: 10.1117/12.462680
Show Author Affiliations
Dev Prasad Chakraborty, Univ. of Pennsylvania (United States)

Published in SPIE Proceedings Vol. 4686:
Medical Imaging 2002: Image Perception, Observer Performance, and Technology Assessment
Dev Prasad Chakraborty; Elizabeth A. Krupinski, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?