Share Email Print
cover

Proceedings Paper

Independent versus sequential reading in ROC studies of computer-assist modalities
Author(s): Sergey V. Beiden; Robert F. Wagner; Kunio Doi; Robert M. Nishikawa; Matthew T. Freedman; Shih-Chung Benedict Lo; Xin-Wei Xu
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

This paper provides results of a statistical analysis of two methods for arranging the temporal sequencing of the unaided vs computer-assisted reading in multiple-reader, multiple- case (MRMC) receiver operating characteristic (ROC) studies of computer-aided detection of solitary pulmonary nodules (SPNs) on chest radiographs. The modes are the Independent mode, in which the readings are separated by a time on the order of one month, and the Sequential mode, in which the CAD-assisted reading immediately follows the unassisted reading. The method of Beiden, Wagner, Campbell (BWC) was used to decompose the variance of the ROC area summary accuracy measure into the components that are correlated across unaided and aided reading conditions and the components that are uncorrelated across these reading conditions. The latter are the only components of variability that contribute to the uncertainty in a measurement of the difference in reader performance between reading conditions. These uncorrelated components were dramatically reduced in the Sequential reading mode compared to the Independent reading mode-while the total reader variability remained almost constant. The results were remarkably similar across two independent studies analyzed. This may have important practical consequences because the Sequential mode is the least demanding on reader logistics and time.

Paper Details

Date Published: 12 April 2002
PDF: 7 pages
Proc. SPIE 4686, Medical Imaging 2002: Image Perception, Observer Performance, and Technology Assessment, (12 April 2002); doi: 10.1117/12.462678
Show Author Affiliations
Sergey V. Beiden, FDA Ctr. for Devices and Radiological Health (United States)
Robert F. Wagner, FDA Ctr. for Devices and Radiological Health (United States)
Kunio Doi, Kurt Rossmann Labs. for Radiologic Image Research/Univ. of Chicago (United States)
Robert M. Nishikawa, Kurt Rossmann Labs. for Radiologic Image Research/Univ. of Chicago (United States)
Matthew T. Freedman, ISIS Ctr./Georgetown Univ. (United States)
Shih-Chung Benedict Lo, ISIS Ctr./Georgetown Univ. (United States)
Xin-Wei Xu, Deus Technologies, Inc. (United States)


Published in SPIE Proceedings Vol. 4686:
Medical Imaging 2002: Image Perception, Observer Performance, and Technology Assessment
Dev Prasad Chakraborty; Elizabeth A. Krupinski, Editor(s)

© SPIE. Terms of Use
Back to Top