Share Email Print
cover

Proceedings Paper

Case sampling in LROC: a Monte Carlo analysis
Format Member Price Non-Member Price
PDF $14.40 $18.00

Paper Abstract

We conducted a series of Monte Carlo simulations to investigate how hypothesis testing for modality effects in multireader localization ROC (LROC) studies is influenced by case effects. One specific goal was to evaluate for LROC studies the Dorfman-Berbaum-Metz method of analyzing case effects in reader data acquired from a single case-set. Previous evaluations with ROC study simulations found the DBM method to be moderately conservative. Our simulations, using procedures adapted from those earlier works, showed the DBM method to be a conservative test of modality effect in LROC studies as well. The degree of conservatism was greater for a critical value of (alpha) equals0.05 than for (alpha) equals0.01, and was not moderated by increased numbers of readers or cases. Other simulations investigated the tradeoff between power and empirical type-I error rate for the DBM method and two standard hypothesis tests. Besides the DBM method, a two-way analysis of variance (ANOVA) was applied to performance indices based on the LROC curve under an assumption of negligible case effects. The third test was a three-way ANOVA applied to performance indices, which required two sets of images per modality. With (alpha) equals0.01, the DBM method outperformed the other tests for studies with low numbers of readers and cases. In most other situations, its performance lagged behind that of the other tests.

Paper Details

Date Published: 26 June 2001
PDF: 10 pages
Proc. SPIE 4324, Medical Imaging 2001: Image Perception and Performance, (26 June 2001); doi: 10.1117/12.431182
Show Author Affiliations
Howard C. Gifford, Univ. of Massachusetts Medical School (United States)
Michael A. King, Univ. of Massachusetts Medical School (United States)


Published in SPIE Proceedings Vol. 4324:
Medical Imaging 2001: Image Perception and Performance
Elizabeth A. Krupinski; Dev Prasad Chakraborty, Editor(s)

© SPIE. Terms of Use
Back to Top