Share Email Print
cover

Proceedings Paper

Comparing signal-based and case-based methodologies for CAD assessment in a detection task
Format Member Price Non-Member Price
PDF $14.40 $18.00

Paper Abstract

We are investigating the potential for differences in study conclusions when assessing the estimated impact of a computer-aided detection (CAD) system on readers' performance using a signal-based performance analysis derived from Free-response Receiver Operating Characteristics (FROC) versus a case-based performance analysis derived from Receiver Operating Characteristics (ROC) analysis. To consider this question, we utilized reader data from a CAD assessment study based on 100 mammographic background images to which fixed-size and fixed-intensity Gaussian signals were added, generating a low- and high-intensity set. The study thus allowed CAD assessment in two situations: when CAD sensitivity was 1) superior or 2) equivalent or lower than the average reader. Seven readers were asked to review each set using CAD in both second-reader and concurrent modes. Signal-based detection results were analyzed using the area under the FROC curve below 0.5 false positives per image. Case-based decision results were analyzed using the area under the parametric ROC curve. The results were consistent between the signal-based and case-based analyses for the low-intensity set, suggesting that CAD in both reading modes can increase reader signal-based detection and case-based decision accuracies. For the high-intensity set, the signal-based and case-based analysis suggested different conclusions regarding the utility of CAD, although neither analysis resulted in statistical significance.

Paper Details

Date Published: 24 March 2008
PDF: 9 pages
Proc. SPIE 6917, Medical Imaging 2008: Image Perception, Observer Performance, and Technology Assessment, 691708 (24 March 2008); doi: 10.1117/12.771498
Show Author Affiliations
Sophie Paquerault, NIBIB/CDRH Lab. for the Assessment of Medical Imaging Systems, FDA (United States)
Frank W. Samuelson, NIBIB/CDRH Lab. for the Assessment of Medical Imaging Systems, FDA (United States)
Nicholas Petrick, NIBIB/CDRH Lab. for the Assessment of Medical Imaging Systems, FDA (United States)
Kyle J. Myers, NIBIB/CDRH Lab. for the Assessment of Medical Imaging Systems, FDA (United States)


Published in SPIE Proceedings Vol. 6917:
Medical Imaging 2008: Image Perception, Observer Performance, and Technology Assessment
Berkman Sahiner; David J. Manning, Editor(s)

© SPIE. Terms of Use
Back to Top