Share Email Print
cover

Proceedings Paper • new

A multimodal vision sensor for autonomous driving
Author(s): Dongming Sun; Xiao Huang; Kailun Yang
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

This paper describes a multimodal vision sensor that integrates three types of cameras, including a stereo camera, a polarization camera and a panoramic camera. Each sensor provides a specific dimension of information: the stereo camera measures depth per pixel, the polarization obtains the degree of polarization, and the panoramic camera captures a 360° landscape. Data fusion and advanced environment perception could be built upon the combination of sensors. Designed especially for autonomous driving, this vision sensor is shipped with a robust semantic segmentation network. In addition, we demonstrate how cross-modal enhancement could be achieved by registering the color image and the polarization image. An example of water hazard detection is given. To prove the multimodal vision sensor’s compatibility with different devices, a brief runtime performance analysis is carried out.

Paper Details

Date Published: 7 October 2019
PDF
Proc. SPIE 11166, Counterterrorism, Crime Fighting, Forensics, and Surveillance Technologies III, 111660L (7 October 2019); doi: 10.1117/12.2535552
Show Author Affiliations
Dongming Sun, Zhejiang Univ. (China)
Xiao Huang, Zhejiang Univ. (China)
Kailun Yang, Zhejiang Univ. (China)


Published in SPIE Proceedings Vol. 11166:
Counterterrorism, Crime Fighting, Forensics, and Surveillance Technologies III
Henri Bouma; Radhakrishna Prabhu; Robert James Stokes; Yitzhak Yitzhaky, Editor(s)

© SPIE. Terms of Use
Back to Top