Share Email Print

Proceedings Paper

Speech recognition technology combined with three-dimensional lip movement
Author(s): Kazumi Komiya; Ryo Ishikawa; Keiko Momose
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

In order to improve speech recognition efficiency under background noise such as out of doors, we propose a new recognition technology combined with three dimensional lip movements. In this paper firstly, three-dimensional movements at four positions of the mouth were measured using principal component analysis to clarify which positions and which directions are main contributors to pronunciation. Secondly, recognition evaluation tests for 50 Japanese words were carried out under noise levels ranging from 40 to 80 dB. In the experiment, over 80% of recognition efficiency was measured at 70dB and improvement of 40% was obtained compared with ordinary speech recognition. From the experimental results, the proposed method can be modified to be used as practical speech recognition technology. Finally, research subjects were picked up such as an improvement in precision of measuring lip movement and experiments and data collection out of doors.

Paper Details

Date Published: 13 April 2001
PDF: 8 pages
Proc. SPIE 4298, Three-Dimensional Image Capture and Applications IV, (13 April 2001); doi: 10.1117/12.424893
Show Author Affiliations
Kazumi Komiya, Kanagawa Institute of Technology (Japan)
Ryo Ishikawa, Kanagawa Institute of Technology (Japan)
Keiko Momose, Kanagawa Institute of Technology (Japan)

Published in SPIE Proceedings Vol. 4298:
Three-Dimensional Image Capture and Applications IV
Brian D. Corner; Joseph H. Nurre; Roy P. Pargas, Editor(s)

© SPIE. Terms of Use
Back to Top