Share Email Print

Proceedings Paper

Thermal-to-visible face recognition using multiple kernel learning
Author(s): Shuowen Hu; Prudhvi Gurram; Heesung Kwon; Alex L. Chan
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

Recognizing faces acquired in the thermal spectrum from a gallery of visible face images is a desired capability for the military and homeland security, especially for nighttime surveillance and intelligence gathering. However, thermal-tovisible face recognition is a highly challenging problem, due to the large modality gap between thermal and visible imaging. In this paper, we propose a thermal-to-visible face recognition approach based on multiple kernel learning (MKL) with support vector machines (SVMs). We first subdivide the face into non-overlapping spatial regions or blocks using a method based on coalitional game theory. For comparison purposes, we also investigate uniform spatial subdivisions. Following this subdivision, histogram of oriented gradients (HOG) features are extracted from each block and utilized to compute a kernel for each region. We apply sparse multiple kernel learning (SMKL), which is a MKLbased approach that learns a set of sparse kernel weights, as well as the decision function of a one-vs-all SVM classifier for each of the subjects in the gallery. We also apply equal kernel weights (non-sparse) and obtain one-vs-all SVM models for the same subjects in the gallery. Only visible images of each subject are used for MKL training, while thermal images are used as probe images during testing. With subdivision generated by game theory, we achieved Rank-1 identification rate of 50.7% for SMKL and 93.6% for equal kernel weighting using a multimodal dataset of 65 subjects. With uniform subdivisions, we achieved a Rank-1 identification rate of 88.3% for SMKL, but 92.7% for equal kernel weighting.

Paper Details

Date Published: 20 June 2014
PDF: 7 pages
Proc. SPIE 9091, Signal Processing, Sensor/Information Fusion, and Target Recognition XXIII, 909110 (20 June 2014); doi: 10.1117/12.2051033
Show Author Affiliations
Shuowen Hu, U.S. Army Research Lab. (United States)
Prudhvi Gurram, U.S. Army Research Lab. (United States)
Heesung Kwon, U.S. Army Research Lab. (United States)
Alex L. Chan, U.S. Army Research Lab. (United States)

Published in SPIE Proceedings Vol. 9091:
Signal Processing, Sensor/Information Fusion, and Target Recognition XXIII
Ivan Kadar, Editor(s)

© SPIE. Terms of Use
Back to Top