Share Email Print

Proceedings Paper

Quality and automation metrics for spectral classification algorithms
Author(s): Erich D. Hernandez-Baquero; Robert V. Opalecky
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Quantitative and robust metrics are required to objectively compare the performance of algorithms within a general functional class. This is especially true for classification algorithms that cluster and label data using spectral features. This is because spectral algorithms are usually based on a finite set of assumptions about the radiative transfer phenomenology. Thus, a suite of algorithms is needed to achieve a generalized and robust processing chain that performs well under all operational scenarios of interest. An adaptive processing chain that automatically selects the optimal combination of algorithms to generate a product of prescribed quality provides a framework for operational applications. To this end, we have developed Measures of Effectiveness (MOE's) and Figures of Merit (FOM's) that can quantitatively and objectively select the appropriate algorithm automatically. The FOM's are a weighted sum of MOE's, which are performance metrics such as the tightness and dissimilarity of clusters. We have also defined scene and sensor parameters that quantify a subset of factors that affect algorithm performance. Functional relationships between FOM's and MOE's and between the FOM's/MOE's and the scene/sensor parameters were also established. These functional relationships allow users to predict the expected classification product quality given a specific operational scenario based on a performance model that also automates the processing chain. Initial results of an application of this approach to hyperspectral data indicate that FOM's can be predicted with high accuracy with choices made correctly as high as 89% of the time depending on the FOM definitions. The results were obtained over a wide range of operational scenarios.

Paper Details

Date Published: 8 November 2002
PDF: 11 pages
Proc. SPIE 4816, Imaging Spectrometry VIII, (8 November 2002); doi: 10.1117/12.451657
Show Author Affiliations
Erich D. Hernandez-Baquero, Air Force Element/U.S. Air Force (United States)
Robert V. Opalecky, Raytheon E-Systems (United States)

Published in SPIE Proceedings Vol. 4816:
Imaging Spectrometry VIII
Sylvia S. Shen, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?