Share Email Print

Proceedings Paper

Gains in accuracy from averaging ratings of abnormality
Author(s): Richard G. Swensson; Jill L. King; David Gur; Walter F. Good
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Six radiologists used continuous scales to rate 529 chest-film cases for likelihood of five separate types of abnormalities (interstitial disease, nodules, pneumothorax, alveolar infiltrates and rib fractures) in each of six replicated readings, yielding 36 separate ratings of each case for the five abnormalities. Analyses for each type of abnormality estimated the relative gains in accuracy (area below the ROC curve) obtained by averaging the case-ratings across: (1) six independent replications by each reader (30% gain), (2) six different readers within each replication (39% gain) or (3) all 36 readings (58% gain). Although accuracy differed among both readers and abnormalities, ROC curves for the median ratings showed similar relative gains in accuracy. From a latent-variable model for these gains, we estimate that about 51% of a reader's total decision variance consisted of random (within-reader) errors that were uncorrelated between replications, another 14% came from that reader's consistent (but idiosyncratic) responses to different cases, and only about 35% could be attributed to systematic variations among the sampled cases that were consistent across different readers.

Paper Details

Date Published: 24 May 1999
PDF: 8 pages
Proc. SPIE 3663, Medical Imaging 1999: Image Perception and Performance, (24 May 1999); doi: 10.1117/12.349630
Show Author Affiliations
Richard G. Swensson, Univ. of Pittsburgh School of Medicine (United States)
Jill L. King, Univ. of Pittsburgh School of Medicine (United States)
David Gur, Univ. of Pittsburgh School of Medicine (United States)
Walter F. Good, Univ. of Pittsburgh School of Medicine (United States)

Published in SPIE Proceedings Vol. 3663:
Medical Imaging 1999: Image Perception and Performance
Elizabeth A. Krupinski, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?