Share Email Print

Proceedings Paper

A robust target recognition and tracking panoramic surveillance system based on deep learning
Author(s): Qiang Fan; ErBo Zou
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

A panoramic monitoring system is designed to achieve continuous monitoring of the surrounding environment. The image acquisition module of the system is composed of five fixed-focal-length cameras and a variable-focal-length camera, which realizes 360 degree environmental monitoring. Usually, the background of continuous photography changes due to fluctuations of ambient light, humidity and wind. Therefore, a dynamic adaptive threshold is used to dynamically update the background template in order to better accommodate various weather changes. Further, a motion-aware algorithm based on background updates is applied to effectively detect whether an intruding target exists and determine the direction of the target. Once an intrusive target is found, the deep convolution neural network Yolo is employed to recognize the target quickly. It shows the advantages of less computation and preferable detection accuracy. In addition, according to the preset warning level, when the intrusion target needs to be alarmed, the target orientation is transmitted to the platform through the central control processing unit, so that the variable-focal-length camera can take real-time snapshots. we propose an end-to-end lightweight siamese convolution neural network to achieve fast and robust target tracking. The network structure replaces the hand-crafted features by the multi-layers deep convolution features of the target, so that higher precision can be achieved. The experiment result shows panoramic surveillance system can effectively and robustly perform security tasks such as panoramic imaging, target recognition and fast target tracking.

Paper Details

Date Published: 20 November 2019
PDF: 6 pages
Proc. SPIE 11192, Real-time Photonic Measurements, Data Management, and Processing IV, 111920Y (20 November 2019); doi: 10.1117/12.2536611
Show Author Affiliations
Qiang Fan, Huazhong Institute of Electro-Optics (China)
ErBo Zou, Huazhong Institute of Electro-Optics (China)

Published in SPIE Proceedings Vol. 11192:
Real-time Photonic Measurements, Data Management, and Processing IV
Ming Li; Bahram Jalali; Mohammad Hossein Asghari, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?