Share Email Print
cover

Proceedings Paper

An interactive VR system based on full-body tracking and gesture recognition
Author(s): Xia Zeng; Xinzhu Sang; Duo Chen; Peng Wang; Nan Guo; Binbin Yan; Kuiru Wang
Format Member Price Non-Member Price
PDF $14.40 $18.00

Paper Abstract

Most current virtual reality (VR) interactions are realized with the hand-held input device which leads to a low degree of presence. There is other solutions using sensors like Leap Motion to recognize the gestures of users in order to interact in a more natural way, but the navigation in these systems is still a problem, because they fail to map the actual walking to virtual walking only with a partial body of the user represented in the synthetic environment. Therefore, we propose a system in which users can walk around in the virtual environment as a humanoid model, selecting menu items and manipulating with the virtual objects using natural hand gestures. With a Kinect depth camera, the system tracks the joints of the user, mapping them to a full virtual body which follows the move of the tracked user. The movements of the feet can be detected to determine whether the user is in walking state, so that the walking of model in the virtual world can be activated and stopped by means of animation control in Unity engine. This method frees the hands of users comparing to traditional navigation way using hand-held device. We use the point cloud data getting from Kinect depth camera to recognize the gestures of users, such as swiping, pressing and manipulating virtual objects. Combining the full body tracking and gestures recognition using Kinect, we achieve our interactive VR system in Unity engine with a high degree of presence.

Paper Details

Date Published: 31 October 2016
PDF: 7 pages
Proc. SPIE 10021, Optical Design and Testing VII, 1002129 (31 October 2016); doi: 10.1117/12.2247808
Show Author Affiliations
Xia Zeng, Beijing Univ. of Posts and Telecommunications (China)
Xinzhu Sang, Beijing Univ. of Posts and Telecommunications (China)
Duo Chen, Beijing Univ. of Posts and Telecommunications (China)
Peng Wang, Beijing Univ. of Posts and Telecommunications (China)
Nan Guo, Beijing Univ. of Posts and Telecommunications (China)
Binbin Yan, Beijing Univ. of Posts and Telecommunications (China)
Kuiru Wang, Beijing Univ. of Posts and Telecommunications (China)


Published in SPIE Proceedings Vol. 10021:
Optical Design and Testing VII
Yongtian Wang; Tina E. Kidger; Kimio Tatsuno, Editor(s)

© SPIE. Terms of Use
Back to Top