Share Email Print

Proceedings Paper

Quantifying the limitations of the use of consensus expert committees in ROC studies
Author(s): Miguel P. Eckstein; Thomas D. Wickens; Gal Aharonov; George Ruan; Craig A. Morioka; James Stuart Whiting
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

Many receiver operating characteristic (ROC) studies rely on establishing 'truth' about lesion absence/presence on the agreement of a panel of experts. In addition, in the consensus committee methodology, images where the members of the committee did not reach any agreement about the lesion absence/presence are discarded from the ROC study. But how reliable are 'gold standards' established by these expert committees. And does discarding images where no agreement was reached bias the spectrum of difficulty of the test image set for the ROC study. Computer simulated lesions of different strengths were embedded in real x-ray coronary angiogram background in order to measure the agreement among the decisions of members of the committee as a function of signal strength, to establish the accuracy of the decisions of the consensus expert committee and to compare it to individual more inexperienced readers.

Paper Details

Date Published: 21 April 1998
PDF: 7 pages
Proc. SPIE 3340, Medical Imaging 1998: Image Perception, (21 April 1998); doi: 10.1117/12.306177
Show Author Affiliations
Miguel P. Eckstein, Cedars Sinai Medical Ctr. (United States)
Thomas D. Wickens, Univ. of California/Los Angeles (United States)
Gal Aharonov, Cedars Sinai Medical Ctr. (United States)
George Ruan, Cedars Sinai Medical Ctr. (United States)
Craig A. Morioka, Cedars Sinai Medical Ctr. (United States)
James Stuart Whiting, Cedars Sinai Medical Ctr. (United States)

Published in SPIE Proceedings Vol. 3340:
Medical Imaging 1998: Image Perception
Harold L. Kundel, Editor(s)

© SPIE. Terms of Use
Back to Top