Share Email Print
cover

Proceedings Paper

Identification of superior discriminations during ROC studies
Author(s): Amy H. Klym; James Ferris; Joan Lacomis; Sara Golla; Thomas Warfel; Barry McCook; Peter Davis; David Gur
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

One way to increase the efficiency of large-scale observer performance studies that utilize receiver-operator- characteristic (ROC) analysis would be to identify a group of observers whose ROC results consistently reflect a strong sensitivity to imaging mode differences. We reviewed the data of four large ROC studies performed by our group. The primary index used to classify observers was defined as the absolute difference between readers' Azs for two modes divided by the standard deviation, appropriately corrected for correlation. Using this index, observers were ranked as to their ability to detect differences between modes. We performed four different analyses on data that included 119,550 observations in four studies and 14 different modes performed by 20 readers. With the exception of one data set, there was no correlation between the level of performance of observers, as measured by Az, and their ability to discriminate between modes. Analyses designed to identify observers who were consistent in their rankings as to their ability to discriminated between modes was also unsuccessful in showing differences. This study suggests that without the use of special procedures or training, it is not likely that most research facilities will be able to select a group of highly experienced observers who consistently detect small differences among modes.

Paper Details

Date Published: 12 April 2002
PDF: 7 pages
Proc. SPIE 4686, Medical Imaging 2002: Image Perception, Observer Performance, and Technology Assessment, (12 April 2002); doi: 10.1117/12.462699
Show Author Affiliations
Amy H. Klym, Magee-Womens Hospital/Univ. of Pittsburgh (United States)
James Ferris, Magee-Womens Hospital/Univ. of Pittsburgh (United States)
Joan Lacomis, Magee-Womens Hospital/Univ. of Pittsburgh (United States)
Sara Golla, Magee-Womens Hospital/Univ. of Pittsburgh (United States)
Thomas Warfel, Magee-Womens Hospital/Univ. of Pittsburgh (United States)
Barry McCook, Magee-Womens Hospital/Univ. of Pittsburgh (United States)
Peter Davis, Magee-Womens Hospital/Univ. of Pittsburgh (United States)
David Gur, Magee-Womens Hospital/Univ. of Pittsburgh (United States)


Published in SPIE Proceedings Vol. 4686:
Medical Imaging 2002: Image Perception, Observer Performance, and Technology Assessment
Dev Prasad Chakraborty; Elizabeth A. Krupinski, Editor(s)

© SPIE. Terms of Use
Back to Top