Share Email Print

Proceedings Paper

Virtual mirror based on 3D-shape reconstruction and real-time face tracking
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Human face gives various kinds of information such as feeling, age, physical condition and so on. Therefore it is important to acquire and reconstruct the facial pattern precisely for various kinds of applications. Our goal is to create the electronic cosmetics systems with real-time tracking of 3D facial pattern. A simple 3D virtual mirror interface system is proposed for acquisition and reconstruction of facial pattern, which enables a real time tracking of 3D facial pattern. The movement of lip in the face, which can be estimated based on mean shift and Kalman filter is introduced to recognize the rotation and parallel shift of face. Modified Photometric Stereo Method is also proposed to acquire the 3D shape without the influence of deficiency in shadow area of the object. It is shown that the proposed system is effective to acquire and reconstruct for the real-time tracking of 3D facial pattern image than traditional approaches. We consider that this interface can be applied to the electronic cosmetics systems that can simulate make-up, plastic surgery and color appearance under various illuminations.

Paper Details

Date Published: 17 January 2005
PDF: 8 pages
Proc. SPIE 5670, Internet Imaging VI, (17 January 2005); doi: 10.1117/12.585841
Show Author Affiliations
Takao Makino, Chiba Univ. (Japan)
Toshiya Nakaguchi, Chiba Univ. (Japan)
Norimichi Tsumura, Chiba Univ. (Japan)
Yoichi Miyake, Chiba Univ. (Japan)

Published in SPIE Proceedings Vol. 5670:
Internet Imaging VI
Simone Santini; Raimondo Schettini; Theo Gevers, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?