Share Email Print
cover

Proceedings Paper

Markerless 3D facial motion capture system
Author(s): Youngkyoo Hwang; Jung-Bae Kim; Xuetao Feng; Won-Chul Bang; Taehyun Rhee; James D.K. Kim; ChangYeong Kim
Format Member Price Non-Member Price
PDF $17.00 $21.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

We propose a novel markerless 3D facial motion capture system using only one common camera. This system is simple and easy to transfer facial expressions of a user's into virtual world. It has robustly tracking facial feature points associated with head movements. In addition, it estimates high accurate 3D points' locations. We designed novel approaches to the followings; Firstly, for precisely 3D head motion tracking, we applied 3D constraints using a 3D face model on conventional 2D feature points tracking approach, called Active Appearance Model (AAM). Secondly, for dealing with various expressions of a user's, we designed 2D face generic models from around 5000 images data and 3D shape data including symmetric and asymmetric facial expressions. Lastly, for accurately facial expression cloning, we invented a manifold space to successfully transfer 2D low dimensional feature points to 3D high dimensional points. The manifold space is defined by eleven facial expression bases.

Paper Details

Date Published: 8 February 2012
PDF: 6 pages
Proc. SPIE 8289, The Engineering Reality of Virtual Reality 2012, 828909 (8 February 2012); doi: 10.1117/12.907528
Show Author Affiliations
Youngkyoo Hwang, Samsung Advanced Institute of Technology (Korea, Republic of)
Jung-Bae Kim, Samsung Advanced Institute of Technology (Korea, Republic of)
Xuetao Feng, Samsung Advanced Institute of Technology (Korea, Republic of)
Won-Chul Bang, Samsung Advanced Institute of Technology (Korea, Republic of)
Taehyun Rhee, Samsung Advanced Institute of Technology (Korea, Republic of)
James D.K. Kim, Samsung Advanced Institute of Technology (Korea, Republic of)
ChangYeong Kim, Samsung Advanced Institute of Technology (Korea, Republic of)


Published in SPIE Proceedings Vol. 8289:
The Engineering Reality of Virtual Reality 2012
Ian E. McDowall; Margaret Dolinsky, Editor(s)

© SPIE. Terms of Use
Back to Top