Share Email Print

Journal of Electronic Imaging

Deep neural network using color and synthesized three-dimensional shape for face recognition
Author(s): Seon-Min Rhee; ByungIn Yoo; Jae-Joon Han; Wonjun Hwang
Format Member Price Non-Member Price
PDF $20.00 $25.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

We present an approach for face recognition using synthesized three-dimensional (3-D) shape information together with two-dimensional (2-D) color in a deep convolutional neural network (DCNN). As 3-D facial shape is hardly affected by the extrinsic 2-D texture changes caused by illumination, make-up, and occlusions, it could provide more reliable complementary features in harmony with the 2-D color feature in face recognition. Unlike other approaches that use 3-D shape information with the help of an additional depth sensor, our approach generates a personalized 3-D face model by using only face landmarks in the 2-D input image. Using the personalized 3-D face model, we generate a frontalized 2-D color facial image as well as 3-D facial images (e.g., a depth image and a normal image). In our DCNN, we first feed 2-D and 3-D facial images into independent convolutional layers, where the low-level kernels are successfully learned according to their own characteristics. Then, we merge them and feed into higher-level layers under a single deep neural network. Our proposed approach is evaluated with labeled faces in the wild dataset and the results show that the error rate of the verification rate at false acceptance rate 1% is improved by up to 32.1% compared with the baseline where only a 2-D color image is used.

Paper Details

Date Published: 22 March 2017
PDF: 4 pages
J. Electron. Imag. 26(2) 020502 doi: 10.1117/1.JEI.26.2.020502
Published in: Journal of Electronic Imaging Volume 26, Issue 2
Show Author Affiliations
Seon-Min Rhee, Samsung Advanced Institute of Technology (Republic of Korea)
ByungIn Yoo, Samsung Advanced Institute of Technology (Republic of Korea)
Korea Advanced Institute of Science and Technology (Republic of Korea)
Jae-Joon Han, Samsung Advanced Institute of Technology (Republic of Korea)
Wonjun Hwang, Ajou University (Republic of Korea)

© SPIE. Terms of Use
Back to Top