Share Email Print
cover

Proceedings Paper

Spectral signature verification using statistical analysis and text mining
Author(s): Mallory E. DeCoster; Alexe H. Firpi; Samantha K. Jacobs; Shelli R. Cone; Nigel H. Tzeng; Benjamin M. Rodriguez
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

In the spectral science community, numerous spectral signatures are stored in databases representative of many sample materials collected from a variety of spectrometers and spectroscopists. Due to the variety and variability of the spectra that comprise many spectral databases, it is necessary to establish a metric for validating the quality of spectral signatures. This has been an area of great discussion and debate in the spectral science community. This paper discusses a method that independently validates two different aspects of a spectral signature to arrive at a final qualitative assessment; the textual meta-data and numerical spectral data. Results associated with the spectral data stored in the Signature Database1 (SigDB) are proposed. The numerical data comprising a sample material’s spectrum is validated based on statistical properties derived from an ideal population set. The quality of the test spectrum is ranked based on a spectral angle mapper (SAM) comparison to the mean spectrum derived from the population set. Additionally, the contextual data of a test spectrum is qualitatively analyzed using lexical analysis text mining. This technique analyzes to understand the syntax of the meta-data to provide local learning patterns and trends within the spectral data, indicative of the test spectrum’s quality. Text mining applications have successfully been implemented for security2 (text encryption/decryption), biomedical3 , and marketing4 applications. The text mining lexical analysis algorithm is trained on the meta-data patterns of a subset of high and low quality spectra, in order to have a model to apply to the entire SigDB data set. The statistical and textual methods combine to assess the quality of a test spectrum existing in a database without the need of an expert user. This method has been compared to other validation methods accepted by the spectral science community, and has provided promising results when a baseline spectral signature is present for comparison. The spectral validation method proposed is described from a practical application and analytical perspective.

Paper Details

Date Published: 17 May 2016
PDF: 13 pages
Proc. SPIE 9840, Algorithms and Technologies for Multispectral, Hyperspectral, and Ultraspectral Imagery XXII, 984025 (17 May 2016); doi: 10.1117/12.2225214
Show Author Affiliations
Mallory E. DeCoster, Johns Hopkins Univ. Applied Physics Lab., LLC (United States)
Alexe H. Firpi, Johns Hopkins Univ. Applied Physics Lab., LLC (United States)
Samantha K. Jacobs, Johns Hopkins Univ. Applied Physics Lab., LLC (United States)
Shelli R. Cone, Johns Hopkins Univ. Applied Physics Lab., LLC (United States)
Nigel H. Tzeng, Johns Hopkins Univ. Applied Physics Lab., LLC (United States)
Benjamin M. Rodriguez, Johns Hopkins Univ. Applied Physics Lab., LLC (United States)


Published in SPIE Proceedings Vol. 9840:
Algorithms and Technologies for Multispectral, Hyperspectral, and Ultraspectral Imagery XXII
Miguel Velez-Reyes; David W. Messinger, Editor(s)

© SPIE. Terms of Use
Back to Top