Share Email Print
cover

Proceedings Paper

CNN-based thermal infrared person detection by domain adaptation
Author(s): Christian Herrmann; Miriam Ruf; Jürgen Beyerer
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Imaging sensors capturing the surroundings of an autonomous vehicle are vital for its understanding of the environment. While thermal infrared cameras promise improved bad weather and nighttime robustness compared with standard RGB cameras, detecting objects, such as persons, in thermal infrared imagery is a tough problem because image resolution and quality is typically far lower, especially for low-cost sensors. Currently, deep learning based object detection frameworks offer an impressive performance on high-quality images. However, applying them to low-quality data in a different spectral range causes significant performance drops. This work proposes a strategy to make use of elaborate CNN-based object detector frameworks which are pre-trained on visual RGB images. Two key steps are undertaken: First, an appropriate preprocessing strategy for the IR data is suggested which transforms the IR data as close as possible to the RGB domain. This allows pre-trained RGB features to be effective on the novel domain. Second, the remaining domain gap is addressed by fine-tuning the pre-trained CNN on a limited set of thermal IR data. Different IR preprocessing options are explored, each addressing a different aspect of the domain gap between thermal IR and RGB data. Examples include dynamic range, blur or contrast. Because no preprocessing can cover all aspects alone, providing preprocessing combinations to the CNN allows addressing more than one aspect at once and further improves the results. Experiments indicate significant person detection improvements on the public KAIST dataset with the optimized preprocessing strategy.

Paper Details

Date Published: 3 May 2018
PDF: 6 pages
Proc. SPIE 10643, Autonomous Systems: Sensors, Vehicles, Security, and the Internet of Everything, 1064308 (3 May 2018); doi: 10.1117/12.2304400
Show Author Affiliations
Christian Herrmann, Fraunhofer-Institut für Optronik, Systemtechnik und Bildauswertung (Germany)
Karlsruhe Institute of Technology (Germany)
Miriam Ruf, Fraunhofer-Institut für Optronik, Systemtechnik und Bildauswertung (Germany)
Jürgen Beyerer, Fraunhofer-Institut für Optronik, Systemtechnik und Bildauswertung (Germany)
Karlsruhe Institute of Technology (Germany)


Published in SPIE Proceedings Vol. 10643:
Autonomous Systems: Sensors, Vehicles, Security, and the Internet of Everything
Michael C. Dudzik; Jennifer C. Ricklin, Editor(s)

© SPIE. Terms of Use
Back to Top