Share Email Print

Proceedings Paper

Understanding of hand motion in sentence level using HMM
Author(s): Boohyung Lee; Youngjoon Han; Hwanik Chung; Hernsoo Hahn
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

This paper proposes a new method that can recognize a sequence of hand motion expressing a sentence in sign language. Recognition procedure is divided into two steps: separation of the sequence of hand motions into the sub-sequences each of which expresses one word and combination of the words in order to construct a sentence having a meaning. In the first step, sequences of hand motion images are segmented by testing the continuity of the hand motions and by the multiscale image segmentation scheme. The trajectory of the hand motions are estimated by the affine transformation. Each sign in the sentence is represented by the extended chereme analysis model and each chereme is represented by the status vector for determining the transition in the HMM. In the second step, each sentence is also represented by the HMM. The Viterbi algorithm and context-dependent HMM are used to find the best state sequence in the HMM. The proposed algorithm has been tested with ten sequences of images, each of which expresses a sentence in Korean sign language. The experimental results have shown that the proposed algorithm can separate the sentence level image sequence into the word level sub-sequences with the success rate of 75% on average and recognize the sentence with the success rate of 80%.

Paper Details

Date Published: 7 June 2004
PDF: 10 pages
Proc. SPIE 5292, Human Vision and Electronic Imaging IX, (7 June 2004); doi: 10.1117/12.526425
Show Author Affiliations
Boohyung Lee, Cheonan National Technical College (South Korea)
Youngjoon Han, Seoul Christian Univ. (South Korea)
Hwanik Chung, Kyungbok College (South Korea)
Hernsoo Hahn, Soongsil Univ. (South Korea)

Published in SPIE Proceedings Vol. 5292:
Human Vision and Electronic Imaging IX
Bernice E. Rogowitz; Thrasyvoulos N. Pappas, Editor(s)

© SPIE. Terms of Use
Back to Top