Share Email Print
cover

Proceedings Paper • new

Velodyne LiDAR and monocular camera data fusion for depth map and 3D reconstruction
Author(s): M. Rayyan Akhtar; Huabiao Qin; Guancheng Chen
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

The autonomous vehicles are required to perceive the environment to take a correct driving decision. The sensors which have been commonly used by autonomous vehicles are the camera and the Light Detection and Ranging (LiDAR). In this work, we have integrated the LiDAR data with the image captured by the camera to assign the color information to the point cloud which resulted in a 3D model and to assign depth information to the image pixels which resulted in a depth map. The LiDAR data is sparse and the resolution of the image is much greater than that of the LiDAR data. In order to match the resolution of the LiDAR data and image data, we had utilized Gaussian Process Regression (GPR) to interpolate the depth map but it was not able to completely fill the empty locations in the depth map. In this paper, we have proposed a method to interpolate the 2D depth map data to completely fill the empty locations in the depth map. In this study, we have used Velodyne VLP-16 LiDAR and a monocular camera. Our method is based on the covariance matrix in which the depth value assigned to the empty locations in depth map is decided according to the value of covariance function in the covariance matrix. Our method surpassed the GPR in run time and interpolation result. This shows that our approach is fast enough in real-time for autonomous vehicles.

Paper Details

Date Published: 14 August 2019
PDF: 11 pages
Proc. SPIE 11179, Eleventh International Conference on Digital Image Processing (ICDIP 2019), 111790E (14 August 2019); doi: 10.1117/12.2539863
Show Author Affiliations
M. Rayyan Akhtar, South China Univ. of Technology (China)
Huabiao Qin, South China Univ. of Technology (China)
Guancheng Chen, South China Univ. of Technology (China)


Published in SPIE Proceedings Vol. 11179:
Eleventh International Conference on Digital Image Processing (ICDIP 2019)
Jenq-Neng Hwang; Xudong Jiang, Editor(s)

© SPIE. Terms of Use
Back to Top