Share Email Print

Proceedings Paper

RT-ROC: a near-real-time performance evaluation tool
Author(s): James M. Baumann; James L. Jackson; Gregory D. Sterling; Erik P. Blasch
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

While modern sensors allow vast amounts of data to be collected in seconds, it can take weeks or months to analyze the data and determine sensor performance. Because of this lag between data collection and usable results, issues such as sensor calibration and algorithm biases are not detected until well after an experiment or test, when it is too late to correct them. Recognizing that a rapid performance snapshot would be extremely valuable in many situations, the AFRL COMPASE Center developed tools to produce receiver operating characteristic (ROC) curves in near real-time for an advanced technology demonstration (ATD) program. These tools, called real-time (RT-ROC) and identification (ID-ROC), gave the evaluation team timely insight into overall system performance, and when substandard results were obtained, diagnostic tests were initiated to determine the underlying causes. These tools have been experiment demonstrated, allowing the COMPASE team to find and fix a sensor error in a matter of hours. This paper will concentrate on RT-ROC and will address analysis tool requirements, operation of the tool during experiments, a walkthrough of the tool using simulated data, and future uses for this application.

Paper Details

Date Published: 19 May 2005
PDF: 11 pages
Proc. SPIE 5807, Automatic Target Recognition XV, (19 May 2005); doi: 10.1117/12.606011
Show Author Affiliations
James M. Baumann, Jacobs Sverdrup (United States)
James L. Jackson, Jacobs Sverdrup (United States)
Gregory D. Sterling, Jacobs Sverdrup (United States)
Erik P. Blasch, Air Force Research Lab. (United States)

Published in SPIE Proceedings Vol. 5807:
Automatic Target Recognition XV
Firooz A. Sadjadi, Editor(s)

© SPIE. Terms of Use
Back to Top