Share Email Print

Proceedings Paper

Real-time CNN-based object detection and classification for outdoor surveillance images: daytime and thermal
Author(s): Meir Zilkha; Assaf B. Spanier
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Real time object detection and classification is essential for outdoor surveillance. Current state of the art real time object detection CNNs are trained on natural image datasets. However, outdoor surveillance images have very different characteristics: objects tend to be small and difficult to distinguish (averaging only 3% of image size). In addition, images come in different modalities, for example, nighttime surveillance images are grayscale thermal images representing heat emission not light reflection. Our dataset of images acquired from surveillance videos is comprised of ˜ 640 Daytime (DAY) color images and ˜ 360 nighttime grayscale THERMAL images. The dataset included three object categories: animals, people and vehicles. Because of the lack of large datasets for these scenarios, we evaluated using the much larger VOC dataset to augment our datasets. We conducted a study to determine the best combination of images to include in the training dataset, and how different types of images (i.e. DAY, THERMAL and VOC) affect each-others performance. We examined state of the art object detection and classification CNN architectures, focusing on accuracy and real time performance. By combining different images types THERMAL, DAY and 1200 VOC images in one dataset, the best results were obtained using transfer learning on YOLO-V3 with SPP, achieving 89.5 mAP for DAY images, and 79.53 mAP for THERMAL images, running at 35 fps. This setup provides a robust solution for many surveillance scenarios: night and daytime; far, small objects, as well as zoomed-in, large objects.

Paper Details

Date Published: 19 September 2019
PDF: 10 pages
Proc. SPIE 11169, Artificial Intelligence and Machine Learning in Defense Applications, 1116902 (19 September 2019); doi: 10.1117/12.2532908
Show Author Affiliations
Meir Zilkha, Azrieli College of Engineering Jerusalem (Israel)
Assaf B. Spanier, Azrieli College of Engineering Jerusalem (Israel)

Published in SPIE Proceedings Vol. 11169:
Artificial Intelligence and Machine Learning in Defense Applications
Judith Dijk, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?