Share Email Print

Proceedings Paper

Monte Carlo validation of a multireader method for receiver operating characteristic discrete rating data: split-plot experimental design
Author(s): Donald D. Dorfman; Kevin S. Berbaum; Russell V. Lenth; Yeh Fong Chen
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

The major purpose of this paper was to evaluate the Dorfman/Berbaum/Metz (DBM) method for analyzing multireader receiver operating characteristic (ROC) discrete rating data on reader split-plot and case split-plot designs. It is not always appropriate or practical for readers to interpret imaging studies of the same patients in all modalities. In split plot designs, either a different sample of readers is assigned to each modality or a different sample of cases is assigned to each modality. For each type of split-plot design, a series of null-case Monte Carlo simulations were conducted. The results suggest that the DBM method provides trustworthy alpha levels with discrete ratings when ROC area is not too large, and case and reader sample sizes are not too small. In other situations, the test tends to be somewhat conservative. Our Monte Carlo simulations show that the DBM multireader method can be validly extended to the reader-split and case- split plot designs.

Paper Details

Date Published: 24 May 1999
PDF: 9 pages
Proc. SPIE 3663, Medical Imaging 1999: Image Perception and Performance, (24 May 1999); doi: 10.1117/12.349629
Show Author Affiliations
Donald D. Dorfman, Univ. of Iowa (United States)
Kevin S. Berbaum, Univ. of Iowa (United States)
Russell V. Lenth, Univ. of Iowa (United States)
Yeh Fong Chen, Univ. of Iowa (United States)

Published in SPIE Proceedings Vol. 3663:
Medical Imaging 1999: Image Perception and Performance
Elizabeth A. Krupinski, Editor(s)

© SPIE. Terms of Use
Back to Top