Share Email Print

Proceedings Paper

A 3D character animation engine for multimodal interaction on mobile devices
Author(s): Enrico Sandali; Fabio Lavagetto; Paolo Pisano
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Talking virtual characters are graphical simulations of real or imaginary persons that enable natural and pleasant multimodal interaction with the user, by means of voice, eye gaze, facial expression and gestures. This paper presents an implementation of a 3D virtual character animation and rendering engine, compliant with the MPEG-4 standard, running on Symbian-based SmartPhones. Real-time animation of virtual characters on mobile devices represents a challenging task, since many limitations must be taken into account with respect to processing power, graphics capabilities, disk space and execution memory size. The proposed optimization techniques allow to overcome these issues, guaranteeing a smooth and synchronous animation of facial expressions and lip movements on mobile phones such as Sony-Ericsson's P800 and Nokia's 6600. The animation engine is specifically targeted to the development of new "Over The Air" services, based on embodied conversational agents, with applications in entertainment (interactive story tellers), navigation aid (virtual guides to web sites and mobile services), news casting (virtual newscasters) and education (interactive virtual teachers).

Paper Details

Date Published: 14 March 2005
PDF: 9 pages
Proc. SPIE 5684, Multimedia on Mobile Devices, (14 March 2005); doi: 10.1117/12.596705
Show Author Affiliations
Enrico Sandali, DIST, Univ. of Genoa (Italy)
Fabio Lavagetto, DIST, Univ. of Genoa (Italy)
Paolo Pisano, DIST, Univ. of Genoa (Italy)

Published in SPIE Proceedings Vol. 5684:
Multimedia on Mobile Devices
Reiner Creutzburg; Jarmo H. Takala, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?