Share Email Print

Proceedings Paper

An improved faster R-CNN approach for robust hand detection and classification in sign language
Author(s): Jinwei Wang; Zhongfu Ye
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

Robust hand detection and classification is one of the most essential tasks in sign language recognition. However, the problem is very challenging due to the complexity of hands in sign language. The performance of existing approaches can be easily affected by the numerous variations of sign language gestures, small and unobtrusive hand areas, and ever changing of hand locations. In this paper, to detect and classify the hands in sign language robustly, such kind of small objects that contain rich information, we propose an improved Faster R-CNN approach, namely Multi-scale Faster RCNN. Our approach extends the framework of the Faster R-CNN and a multi-scale strategy is adopted to incorporate hierarchical convolution feature maps. We evaluate our approach on the self-built sign language dataset and the experimental results demonstrate the effectiveness of our proposed approach.

Paper Details

Date Published: 9 August 2018
PDF: 6 pages
Proc. SPIE 10806, Tenth International Conference on Digital Image Processing (ICDIP 2018), 108061B (9 August 2018); doi: 10.1117/12.2503080
Show Author Affiliations
Jinwei Wang, Univ. of Science and Technology of China (China)
Zhongfu Ye, Univ. of Science and Technology of China (China)

Published in SPIE Proceedings Vol. 10806:
Tenth International Conference on Digital Image Processing (ICDIP 2018)
Xudong Jiang; Jenq-Neng Hwang, Editor(s)

© SPIE. Terms of Use
Back to Top