Share Email Print

Proceedings Paper

Probability densities and confidence intervals for target recognition performance metrics
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Probability densities for target recognition performance metrics are developed. These densities assist in evaluation of systems under test (SUTs), which are systems that predict the presence of a target after examination of an input. After such examination, a SUT assigns a score that indicates the predicted likelihood that a target is present. From scores for a series of many inputs, the suitability of a SUT can be evaluated through performance metrics such as the receiver operating characteristic (ROC) and the confidence error (CE) generation curve. The ROC is a metric that describes how well the probability densities of target and clutter scores are separated, where clutter refers to the absence of target. The CE generation curve and the corresponding scalar CE is a metric that evaluates the accuracy of the score. Since only a limited number of test scores (scores for which the truth state is known by the evaluator) is typically available to evaluate a SUT, it is critical to quantify uncertainty in the performance metric results. A process for estimating such uncertainty through probability densities for the performance metrics is examined here. Once the probability densities are developed, confidence intervals are also obtained. The process that develops the densities and related confidence intervals is implemented in a fully Bayesian manner. Two approaches are examined, one which makes initial assumptions regarding the form of the underlying target and clutter densities and a second approach which avoids such assumptions. The target and clutter density approach is applicable to additional performance metrics.

Paper Details

Date Published: 19 May 2005
PDF: 10 pages
Proc. SPIE 5808, Algorithms for Synthetic Aperture Radar Imagery XII, (19 May 2005); doi: 10.1117/12.602322
Show Author Affiliations
David R. Parker, Air Force Institute of Technology (United States)
Steven C. Gustafson, Air Force Institute of Technology (United States)
Timothy D. Ross, Air Force Research Lab. (United States)

Published in SPIE Proceedings Vol. 5808:
Algorithms for Synthetic Aperture Radar Imagery XII
Edmund G. Zelnio; Frederick D. Garber, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?