Share Email Print

Proceedings Paper

MARTI: man-machine animation real-time interface
Author(s): Christian Martyn Jones; Satnam Singh Dlay
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

The research introduces MARTI (man-machine animation real-time interface) for the realization of natural human-machine interfacing. The system uses simple vocal sound-tracks of human speakers to provide lip synchronization of computer graphical facial models. We present novel research in a number of engineering disciplines, which include speech recognition, facial modeling, and computer animation. This interdisciplinary research utilizes the latest, hybrid connectionist/hidden Markov model, speech recognition system to provide very accurate phone recognition and timing for speaker independent continuous speech, and expands on knowledge from the animation industry in the development of accurate facial models and automated animation. The research has many real-world applications which include the provision of a highly accurate and 'natural' man-machine interface to assist user interactions with computer systems and communication with one other using human idiosyncrasies; a complete special effects and animation toolbox providing automatic lip synchronization without the normal constraints of head-sets, joysticks, and skilled animators; compression of video data to well below standard telecommunication channel bandwidth for video communications and multi-media systems; assisting speech training and aids for the handicapped; and facilitating player interaction for 'video gaming' and 'virtual worlds.' MARTI has introduced a new level of realism to man-machine interfacing and special effect animation which has been previously unseen.

Paper Details

Date Published: 15 May 1997
PDF: 12 pages
Proc. SPIE 3012, Stereoscopic Displays and Virtual Reality Systems IV, (15 May 1997); doi: 10.1117/12.274477
Show Author Affiliations
Christian Martyn Jones, Univ. of Newcastle upon Tyne (United Kingdom)
Satnam Singh Dlay, Univ. of Newcastle upon Tyne (United Kingdom)

Published in SPIE Proceedings Vol. 3012:
Stereoscopic Displays and Virtual Reality Systems IV
Scott S. Fisher; John O. Merritt; Mark T. Bolas, Editor(s)

© SPIE. Terms of Use
Back to Top