Share Email Print

Proceedings Paper

Action recognition in depth video from RGB perspective: A knowledge transfer manner
Author(s): Jun Chen; Yang Xiao; Zhiguo Cao; Zhiwen Fang
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Different video modal for human action recognition has becoming a highly promising trend in the video analysis. In this paper, we propose a method for human action recognition from RGB video to Depth video using domain adaptation, where we use learned feature from RGB videos to do action recognition for depth videos. More specifically, we make three steps for solving this problem in this paper. First, different from image, video is more complex as it has both spatial and temporal information, in order to better encode this information, dynamic image method is used to represent each RGB or Depth video to one image, based on this, most methods for extracting feature in image can be used in video. Secondly, as video can be represented as image, so standard CNN model can be used for training and testing for videos, beside, CNN model can be also used for feature extracting as its powerful feature expressing ability. Thirdly, as RGB videos and Depth videos are belong to two different domains, in order to make two different feature domains has more similarity, domain adaptation is firstly used for solving this problem between RGB and Depth video, based on this, the learned feature from RGB video model can be directly used for Depth video classification. We evaluate the proposed method on one complex RGB-D action dataset (NTU RGB-D), and our method can have more than 2% accuracy improvement using domain adaptation from RGB to Depth action recognition.

Paper Details

Date Published: 9 April 2018
PDF: 8 pages
Proc. SPIE 10609, MIPPR 2017: Pattern Recognition and Computer Vision, 1060916 (9 April 2018);
Show Author Affiliations
Jun Chen, Huazhong Univ. of Science and Technology (China)
Yang Xiao, Huazhong Univ. of Science and Technology (China)
Zhiguo Cao, Huazhong Univ. of Science and Technology (China)
Zhiwen Fang, Hunan Univ. of Humanities, Science and Technology (China)

Published in SPIE Proceedings Vol. 10609:
MIPPR 2017: Pattern Recognition and Computer Vision
Zhiguo Cao; Yuehuang Wang; Chao Cai, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?