Share Email Print

Proceedings Paper

Indices of performance
Author(s): Sean M. Hammond; Ian R. L. Davies
Format Member Price Non-Member Price
PDF $17.00 $21.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

We explore the relative value of a number of commonly used performance indices in breast cancer screening by mammography. Such indices are used extensively in quality assurance evaluation of the screening services on offer and it is important that they provide an accurate measure of performance. The conditional probabilities, sensitivity and specificity are widely used as measures of performance. While these measures are necessary elements in performance evaluation, there is an interest in providing a single composite measure of general performance which remains stable over situations with differing incidence of abnormality. Such indices should be useful in the evaluation of performance of individual screeners as well as entire screening centers. In addition they will be of value in the assessment of training where the ratio of abnormal to normal mammograms is higher than in practice. Three classes of overall performance index are identified and discussed, probabilities, area under the ROC, and correlation. A Monte Carlo study is described in which 13 indices are compared on a large number of data sets with various criteria levels. Criteria used to evaluate these indices were as follows: ease of interpretation, ease of calculation, evenness of distribution, not influenced by differences in criteria. Two indices emerge with properties that make them particularly useful for mammography screening. These are the Pollack-Norman Area index and the point-symmetry adjusted phi (or G-Index).

Paper Details

Date Published: 1 April 1994
PDF: 9 pages
Proc. SPIE 2166, Medical Imaging 1994: Image Perception, (1 April 1994); doi: 10.1117/12.171738
Show Author Affiliations
Sean M. Hammond, Univ. of Surrey (United Kingdom)
Ian R. L. Davies, Univ. of Surrey (United Kingdom)

Published in SPIE Proceedings Vol. 2166:
Medical Imaging 1994: Image Perception
Harold L. Kundel, Editor(s)

© SPIE. Terms of Use
Back to Top