Share Email Print

Proceedings Paper

Fusion of millimeter wave radar and RGB-depth sensors for assisted navigation of the visually impaired
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

According to the data from the World Health Organization, 285 million people are estimated to be visually impaired worldwide, and 39 million are blind. It is very difficult for visually impaired people to perceive and avoid obstacles at a distance during their travelling. To address this problem, we propose a sensor fusion system, which combines the RGBDepth sensor and millimeter wave radar sensor, to detect the surrounding obstacles. The range and velocity of multiple obstacles are acquired by the millimeter wave radar based on the principle of frequency modulated continuous wave. The positions of the obstacles are verified by the RGB-Depth sensor based on the contour extraction and MeanShift algorithm. The data fusion algorithm based on particle filters obtains accurate state estimation by fusing RGB-Depth data with millimeter wave radar data. The experiment results show that multiple obstacles with different ranges and angles are successfully detected by the proposed system. The measurement uncertainties are reduced by the data fusion system, meanwhile the effective detectable range is expanded compared to the detection with only RGB-Depth sensor. Moreover, the measurement results are stable when the illumination varies. As a wearable prototype, the sensor fusion system has the characteristics of versatility, portability and cost-effectiveness, which is very suitable for blind navigation application.

Paper Details

Date Published: 5 October 2018
PDF: 8 pages
Proc. SPIE 10800, Millimetre Wave and Terahertz Sensors and Technology XI, 1080006 (5 October 2018); doi: 10.1117/12.2324626
Show Author Affiliations
Ningbo Long, Zhejiang Univ. (China)
Kaiwei Wang, Zhejiang Univ. (China)
Ruiqi Cheng, Zhejiang Univ. (China)
Kailun Yang, Zhejiang Univ. (China)
Jian Bai, Zhejiang Univ. (China)

Published in SPIE Proceedings Vol. 10800:
Millimetre Wave and Terahertz Sensors and Technology XI
Neil A. Salmon; Frank Gumbmann, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?