Share Email Print

Proceedings Paper

TERNet: A deep learning approach for thermal face emotion recognition
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Facial emotion recognition technology finds numerous real-life applications in areas of virtual learning, cognitive psychology analysis, avatar animation, neuromarketing, human machine interactions, and entertainment systems. Most state-of-the-art techniques focus primarily on visible spectrum information for emotion recognition. This becomes very arduous as emotions of individuals vary significantly. Moreover, visible images are susceptible to variation in illumination. Low lighting, variation in poses, aging, and disguise have a substantial impact on the appearance of images and textural information. Even though great advances have been made in the field, facial emotion recognition using existing techniques is often not satisfactory when compared to human performance. To overcome these shortcomings, thermal images are preferred to visible images. Thermal images a) are less sensitive to lighting conditions, b) have consistent thermal signatures, and c) have a temperature distribution formed by the face vein branches. This paper proposes a robust emotion recognition system using thermal images- TERNet. To accomplish this, customized convolutional neural network(CNNs) is employed, which possess excellent generalization capabilities. The architecture adopts features obtained via transfer learning from the VGG-Face CNN model, which is further fine-tuned with the thermal expression face data from the TUFTS face database. Computer simulations demonstrate an accuracy of 96.2% when compared to the state-of-the-art models.

Paper Details

Date Published: 13 May 2019
PDF: 7 pages
Proc. SPIE 10993, Mobile Multimedia/Image Processing, Security, and Applications 2019, 1099309 (13 May 2019); doi: 10.1117/12.2518708
Show Author Affiliations
Shreyas Kamath K. M., Tufts Univ. (United States)
Rahul Rajendran, Tufts Univ. (United States)
Qianwen Wan, Tufts Univ. (United States)
Karen Panetta, Tufts Univ. (United States)
Sos S. Agaian, The City Univ. of New York (United States)

Published in SPIE Proceedings Vol. 10993:
Mobile Multimedia/Image Processing, Security, and Applications 2019
Sos S. Agaian; Vijayan K. Asari; Stephen P. DelMarco, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?