Share Email Print
cover

Proceedings Paper

Quadratic mutual information for dimensionality reduction and classification
Author(s): David M. Gray; José C. Principe
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

A research area based on the application of information theory to machine learning has attracted considerable interest in the last few years. This research area has been coined information-theoretic learning within the community. In this paper we apply elements of information-theoretic learning to the problem of automatic target recognition (ATR). A number of researchers have previously shown the benefits of designing classifiers based on maximizing the mutual information between the class data and the class labels. Following prior research in information-theoretic learning, in the current results we show that quadratic mutual information, derived using a special case of the more general Renyi's entropy, can be used for classifier design. In this implementation, a simple subspace projection classifier is formulated to find the optimal projection weights such that the quadratic mutual information between the class data and the class labels is maximized. This subspace projection accomplishes a dimensionality reduction of the raw data set wherein information about the class membership is retained while irrelevant information is discarded. A subspace projection based on this criterion preserves as much class discriminability as possible within the subspace. For this paper, laser radar images are used to demonstrate the results. Classification performance against this data set is compared for a gradient descent MLP classifier and a quadratic mutual information MLP classifier.

Paper Details

Date Published: 13 May 2010
PDF: 8 pages
Proc. SPIE 7696, Automatic Target Recognition XX; Acquisition, Tracking, Pointing, and Laser Systems Technologies XXIV; and Optical Pattern Recognition XXI, 76960D (13 May 2010); doi: 10.1117/12.852760
Show Author Affiliations
David M. Gray, Univ. of Florida (United States)
José C. Principe, Univ. of Florida (United States)


Published in SPIE Proceedings Vol. 7696:
Automatic Target Recognition XX; Acquisition, Tracking, Pointing, and Laser Systems Technologies XXIV; and Optical Pattern Recognition XXI
Firooz A. Sadjadi; David P. Casasent; Steven L. Chodos; Abhijit Mahalanobis; William E. Thompson; Tien-Hsin Chao, Editor(s)

© SPIE. Terms of Use
Back to Top