Share Email Print
cover

Proceedings Paper

Redefining automatic target recognition (ATR) performance standards
Author(s): Donald Waagen; Charles Hester; Ben Schmid; Margaret Phillips; M. Shane Thompson; Steven Vanstone; Kelly Risko
Format Member Price Non-Member Price
PDF $14.40 $18.00

Paper Abstract

Present descriptors for Automatic Target Recognition (ATR) performance are inadequate for use in comparing algorithms that are purported to be a solution to the problem. The use of receiver operator characteristic curves (ROCs) is a defacto standard, but they do not communicate several key performance measures, including (i) intrinsic separation between classes in the input space, (ii) the efficacy of the mapping induced by the algorithm, (iii) the complexity of the algorithmic mapping, and (iv) a measure of the generalization of the proposed solution. Previous work by Sims et. al.2,5 has addressed the distortion of the evaluation sets to indicate an algorithm's capability (or lack thereof) for generalization and handling of unspecified cases. This paper addresses the rethinking of the summary statistics used for understanding the performance of a solution. We propose new approaches for solution characterization, allowing algorithm performance comparison in an equitable and insightful manner. This paper proffers some examples and suggests directions for new work from the community in this field.

Paper Details

Date Published: 19 May 2011
PDF: 10 pages
Proc. SPIE 8049, Automatic Target Recognition XXI, 80490Z (19 May 2011); doi: 10.1117/12.886308
Show Author Affiliations
Donald Waagen, U.S. Army Research, Development, and Engineering Command (United States)
Charles Hester, U.S. Army Research, Development, and Engineering Command (United States)
Ben Schmid, U.S. Army Research, Development, and Engineering Command (United States)
Margaret Phillips, U.S. Army Research, Development, and Engineering Command (United States)
M. Shane Thompson, U.S. Army Research, Development, and Engineering Command (United States)
Steven Vanstone, U.S. Army Research, Development, and Engineering Command (United States)
Kelly Risko, U.S. Army Research, Development, and Engineering Command (United States)


Published in SPIE Proceedings Vol. 8049:
Automatic Target Recognition XXI
Firooz A. Sadjadi; Abhijit Mahalanobis, Editor(s)

© SPIE. Terms of Use
Back to Top