Share Email Print

Proceedings Paper

Mouth shape detection and tracking using an active mesh
Author(s): Yao Wang; Ru-Shang Wang; Ouseb Lee; Tsuhan Chen; Homer H. Chen; Barry G. Haskell
Format Member Price Non-Member Price
PDF $14.40 $18.00

Paper Abstract

In this paper, we describe an approach to detecting and tracking certain feature points in the mouth region in a talking head sequence. These feature points are interconnected in a polygononal mesh so that the detection and tracking of these points is based on the information not only at these points but also in the surrounding elements. The detection of the nodes in an initial frame is accomplished by a feature detection algorithm. The tracking of these nodes in successive frames is obtained by deforming the mesh so that, when one mesh is warped to the other, the image patterns over corresponding elements in two meshes match with each other. This is accomplished by a modified Newton algorithm which iteratively minimized the error between the two images after mesh-based- warping. The numerical calculation involved in the optimization approach is simplified by using the concept of master elements and shape functions in the finite element method. This algorithm has been applied to a SIF resolution sequence, which contains fairly rapid mouth movement. Our simulation results show that this algorithm can locate and track the feature points in the mouth region quite accurately.

Paper Details

Date Published: 21 April 1995
PDF: 12 pages
Proc. SPIE 2501, Visual Communications and Image Processing '95, (21 April 1995); doi: 10.1117/12.206647
Show Author Affiliations
Yao Wang, Polytechnic Univ. (United States)
Ru-Shang Wang, Polytechnic Univ. (United States)
Ouseb Lee, POSDATA Ltd. (South Korea)
Tsuhan Chen, AT&T Bell Labs. (United States)
Homer H. Chen, AT&T Bell Labs. (United States)
Barry G. Haskell, AT&T Bell Labs. (United States)

Published in SPIE Proceedings Vol. 2501:
Visual Communications and Image Processing '95
Lance T. Wu, Editor(s)

© SPIE. Terms of Use
Back to Top