Share Email Print
cover

Proceedings Paper

Observer evaluation of computer-aided detection: second reader versus concurrent reader scenario
Format Member Price Non-Member Price
PDF $14.40 $18.00

Paper Abstract

We are comparing the performance of computer-aided detection (CAD) used as a second reader to concurrent-use CAD. We have designed a multi-reader multi-case (MRMC) observer study using fixed-size mammographic background images with fixed intensity Gaussian signals added in two experiments. A CAD system was developed to automatically detect these signals. The two experiments utilized signals of different contrast levels to assess the impact of CAD when the standalone CAD sensitivity was superior (low contrast) or equivalent (high contrast) to the average reader in the study. Seven readers participated in the study and were asked to review 100 images, identify signal locations, and rate each on a 100-point scale. A rating of 50 was used as a cutpoint and provided a binary classification of each candidate. Readers read the case set using CAD in both the second-reader and concurrent-reader scenarios. Results from the different signal intensities and reading paradigms were analyzed using the area under the Free-response Receiver Operating Characteristics curves. Sensitivity and the average number of FPs/image were also determined. The results showed that CAD, either used as a second reader or as a concurrent reader, can increase reader sensitivity but with an increase in FPs. The study demonstrated that readers may benefit from concurrent CAD when CAD standalone performance outperforms average reader sensitivity. However, this trend was not observed when CAD performance was equivalent to the sensitivity of the average reader.

Paper Details

Date Published: 8 March 2007
PDF: 8 pages
Proc. SPIE 6515, Medical Imaging 2007: Image Perception, Observer Performance, and Technology Assessment, 65151N (8 March 2007); doi: 10.1117/12.707778
Show Author Affiliations
Sophie Paquerault, NIBIB/CDRH Lab. for the Assessment of Medical Imaging Systems, FDA (United States)
Darin I. Wade, NIBIB/CDRH Lab. for the Assessment of Medical Imaging Systems, FDA (United States)
Nicholas Petrick, NIBIB/CDRH Lab. for the Assessment of Medical Imaging Systems, FDA (United States)
Kyle J. Myers, NIBIB/CDRH Lab. for the Assessment of Medical Imaging Systems, FDA (United States)
Frank W. Samuelson, NIBIB/CDRH Lab. for the Assessment of Medical Imaging Systems, FDA (United States)


Published in SPIE Proceedings Vol. 6515:
Medical Imaging 2007: Image Perception, Observer Performance, and Technology Assessment
Yulei Jiang; Berkman Sahiner, Editor(s)

© SPIE. Terms of Use
Back to Top