Share Email Print

Proceedings Paper

Real-time action recognition based on enhanced motion vector temporal segment network
Author(s): Xue Bai; Enqing Chen; Haron Chweya Tinega
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

At present, the method based on two-stream network has achieved good recognition performance in action recognition, however, its real-time performance is obstructed due to the high computational cost of optical flow. Temporal Segment Network (TSN), a successful example based on the two-stream network, achieves high recognition performance but cannot be processed in real time. In this paper, the motion vector TSN (MV-TSN) is proposed by introducing the motion vector into temporal segment networks, which greatly speeds up the processing speed of TSN. In order to solve the problem of performance degradation caused by the motion vectors lacking fine structure information, we propose a knowledge transfer strategy, which initializes the MV-TSN with the fine knowledge learned by optical flow. The experimental results show that the proposed method achieves a comparable recognition performance to the previous state-of-the-art approaches on UCF-101 and HMDB-51, and the processing speed is 206.2 fps, which is 13 times of the original TSN.

Paper Details

Date Published: 14 August 2019
PDF: 9 pages
Proc. SPIE 11179, Eleventh International Conference on Digital Image Processing (ICDIP 2019), 111791W (14 August 2019); doi: 10.1117/12.2540268
Show Author Affiliations
Xue Bai, Zhengzhou Univ. (China)
Enqing Chen, Zhengzhou Univ. (China)
Haron Chweya Tinega, Zhengzhou Univ. (China)

Published in SPIE Proceedings Vol. 11179:
Eleventh International Conference on Digital Image Processing (ICDIP 2019)
Jenq-Neng Hwang; Xudong Jiang, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?