Share Email Print

Proceedings Paper

Visual speech generator
Author(s): Gregor A. Kalberer; Pascal Mueller; Luc J. Van Gool
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

Efficient, realistic face animation is still a challenge. A system is proposed that yields realistic animations for speech. It starts from real 3D face dynamics, observed at a frame rate of 25 fps for thousands of points on the faces of speaking actors. When asked to animate a face it replicates the visemes that is has learned, and adds the necessary coarticulation effects. The speech animation could be based on as few as 16 modes, extracted through Independent Component Analysis from the observed face dynamics. Also faces for which only a static, neutral 3D model is available, can be animated. Rather then animating via verbatim copying other faces’ deformation fields, the visemes are adapted to the shape of the new face. By localising this face in a Face Space, where also the locations of the example faces are known, visemes are adapted automatically according to the relative distance with respect to these examples. The animation tool proposes a good speech-based face animation as a point of departure for animators, who also get support by the system to then make further changes as desired.

Paper Details

Date Published: 10 January 2003
PDF: 8 pages
Proc. SPIE 5013, Videometrics VII, (10 January 2003); doi: 10.1117/12.473124
Show Author Affiliations
Gregor A. Kalberer, ETH Zurich (Switzerland)
Pascal Mueller, ETH Zurich (Switzerland)
Luc J. Van Gool, ETH Zurich (Switzerland)
Katholieke Univ. Leuven (Belgium)

Published in SPIE Proceedings Vol. 5013:
Videometrics VII
Sabry F. El-Hakim; Armin Gruen; James S. Walton, Editor(s)

© SPIE. Terms of Use
Back to Top