Share Email Print
cover

Proceedings Paper

Analysis of components of variance in multiple-reader studies of computer-aided diagnosis with different tasks
Author(s): Sergey V. Beiden; Robert F. Wagner; Gregory Campbell; Charles E. Metz; Heang-Ping Chan; Robert M. Nishikawa; Mitchell D. Schnall; Yulei Jiang
Format Member Price Non-Member Price
PDF $14.40 $18.00

Paper Abstract

In recent years, the multiple-reader, multiple-case (MRMC) study paradigm has become widespread for receiver operating characteristic (ROC) assessment of systems for diagnostic imaging and computer-aided diagnosis. We review how MRMC data can be analyzed in terms of the multiple components of the variance (case, reader, interactions) observed in those studies. Such information is useful for the design of pivotal studies from results of a pilot study and also for studying the effects of reader training. Recently, several of the present authors have demonstrated methods to generalize the analysis of multiple variance components to the case where unaided readers of diagnostic images are compared with readers who receive the benefit of a computer assist (CAD). For this case it is necessary to model the possibility that several of the components of variance might be reduced when readers incorporate the computer assist, compared to the unaided reading condition. We review results of this kind of analysis on three previously published MRMC studies, two of which were applications of CAD to diagnostic mammography and one was an application of CAD to screening mammography. The results for the three cases are seen to differ, depending on the reader population sampled and the task of interest. Thus, it is not possible to generalize a particular analysis of variance components beyond the tasks and populations actually investigated.

Paper Details

Date Published: 26 June 2001
PDF: 10 pages
Proc. SPIE 4324, Medical Imaging 2001: Image Perception and Performance, (26 June 2001); doi: 10.1117/12.431185
Show Author Affiliations
Sergey V. Beiden, FDA Ctr. for Devices and Radiological Health (United States)
Robert F. Wagner, FDA Ctr. for Devices and Radiological Health (United States)
Gregory Campbell, FDA Ctr. for Devices and Radiological Health (United States)
Charles E. Metz, Univ. of Chicago (United States)
Heang-Ping Chan, Univ. of Michigan (United States)
Robert M. Nishikawa, Univ. of Chicago (United States)
Mitchell D. Schnall, Univ. of Pennsylvania (United States)
Yulei Jiang, Univ. of Chicago (United States)


Published in SPIE Proceedings Vol. 4324:
Medical Imaging 2001: Image Perception and Performance
Elizabeth A. Krupinski; Dev Prasad Chakraborty, Editor(s)

© SPIE. Terms of Use
Back to Top