Share Email Print

Proceedings Paper

Generalization ability of region proposal networks for multispectral person detection
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Multispectral person detection aims at automatically localizing humans in images that consist of multiple spectral bands. Usually, the visual-optical (VIS) and the thermal infrared (IR) spectra are combined to achieve higher robustness for person detection especially in insufficiently illuminated scenes. This paper focuses on analyzing existing detection approaches for their generalization ability. Generalization is a key feature for machine learning based detection algorithms that are supposed to perform well across different datasets. Inspired by recent literature regarding person detection in the VIS spectrum, we perform a cross-validation study to empirically determine the most promising dataset to train a well-generalizing detector. Therefore, we pick one reference Deep Convolutional Neural Network (DCNN) architecture as well as three different multispectral datasets. The Region Proposal Network (RPN) that was originally introduced for object detection within the popular Faster R-CNN is chosen as a reference DCNN. The reason for this choice is that a stand-alone RPN is able to serve as a competitive detector for two-class problems such as person detection. Furthermore, all current state-of-the-art approaches initially apply an RPN followed by individual classifiers. The three considered datasets are the KAIST Multispectral Pedestrian Benchmark including recently published improved annotations for training and testing, the Tokyo Multi-spectral Semantic Segmentation dataset, and the OSU Color-Thermal dataset including just recently released annotations. The experimental results show that the KAIST Multispectral Pedestrian Benchmark with its improved annotations provides the best basis to train a DCNN with good generalization ability compared to the other two multispectral datasets. On average, this detection model achieves a log-average Miss Rate (MR) of 29.74% evaluated on the reasonable test subsets of the three analyzed datasets.

Paper Details

Date Published: 14 May 2019
PDF: 14 pages
Proc. SPIE 10988, Automatic Target Recognition XXIX, 109880Y (14 May 2019); doi: 10.1117/12.2520705
Show Author Affiliations
Kevin Fritz, HENSOLDT Optronics GmbH (Germany)
Aalen Univ. of Applied Sciences (Germany)
Daniel König, HENSOLDT Optronics GmbH (Germany)
Ulrich Klauck, Aalen Univ. of Applied Sciences (Germany)
Michael Teutsch, HENSOLDT Optronics GmbH (Germany)

Published in SPIE Proceedings Vol. 10988:
Automatic Target Recognition XXIX
Riad I. Hammoud; Timothy L. Overman, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?