Share Email Print

Proceedings Paper

Advances to the development of a basic Mexican sign-to-speech and text language translator
Author(s): G. Garcia-Bautista; F. Trujillo-Romero; G. Diaz-Gonzalez
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Sign Language (SL) is the basic alternative communication method between deaf people. However, most of the hearing people have trouble understanding the SL, making communication with deaf people almost impossible and taking them apart from daily activities. In this work we present an automatic basic real-time sign language translator capable of recognize a basic list of Mexican Sign Language (MSL) signs of 10 meaningful words, letters (A-Z) and numbers (1-10) and translate them into speech and text. The signs were collected from a group of 35 MSL signers executed in front of a Microsoft Kinect™ Sensor. The hand gesture recognition system use the RGB-D camera to build and storage data point clouds, color and skeleton tracking information. In this work we propose a method to obtain the representative hand trajectory pattern information. We use Euclidean Segmentation method to obtain the hand shape and Hierarchical Centroid as feature extraction method for images of numbers and letters. A pattern recognition method based on a Back Propagation Artificial Neural Network (ANN) is used to interpret the hand gestures. Finally, we use K-Fold Cross Validation method for training and testing stages. Our results achieve an accuracy of 95.71% on words, 98.57% on numbers and 79.71% on letters. In addition, an interactive user interface was designed to present the results in voice and text format.

Paper Details

Date Published: 28 September 2016
PDF: 11 pages
Proc. SPIE 9971, Applications of Digital Image Processing XXXIX, 99713E (28 September 2016); doi: 10.1117/12.2238281
Show Author Affiliations
G. Garcia-Bautista, Technological Univ. of the Mixteca (Mexico)
F. Trujillo-Romero, Technological Univ. of the Mixteca (Mexico)
G. Diaz-Gonzalez, Technological Univ. of the Mixteca (Mexico)

Published in SPIE Proceedings Vol. 9971:
Applications of Digital Image Processing XXXIX
Andrew G. Tescher, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?