Share Email Print

Proceedings Paper

FringeMatchNet: effective stereo matching onboard of mobile structured light 3D scanner
Author(s): Vladimir V. Kniaz
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Precise and robust 3D model reconstruction is required in various outdoor scenarios such as aircraft inspection, rapid prototyping, and documentation of an archaeological site. This paper is focused on the development of a mobile structured light 3D scanner for online reconstruction. We use a structured light projection for fast data acquisition. We use deep learning based pattern matching to improve accuracy up to 0.1 pixels. Our FringeMatchNet is based on the U-Net architecture. The network produces an estimated shift heatmap with subpixel accuracy. Each pixel (x, y) of the heatmap represents the probability that the shift between the two image patches is equal to (x, y). We generated a large dataset that combines synthetic and real image patches to train our FringeMatchNet. We compare the accuracy of our FringeMatchNet with other stereo matching algorithms both hand-crafted (SGM, LSM) and modern deep learning-based. The evaluation proves that our network outperforms hand-crafted methods and competes with modern state-of-the-art deep learning based algorithms. Our scanner provides the measuring volume of 400 × 300 × 200 mm for an object distance of 600–700 mm. It combines portability with an object point resolution between 0.2 and 0.1 mm. We made our FringeMatchNet and the training dataset publicly available. Deep learning-based stereo matching using our FringeMatchNet facilitates subpixel registration and allows our scanner to achieve sub-millimeter accuracy in the object space.

Paper Details

Date Published: 12 July 2019
PDF: 9 pages
Proc. SPIE 11058, Optics for Arts, Architecture, and Archaeology VII, 1105815 (12 July 2019); doi: 10.1117/12.2525871
Show Author Affiliations
Vladimir V. Kniaz, GosNIIAS (Russian Federation)
Moscow Institute of Physics and Technology (Russian Federation)

Published in SPIE Proceedings Vol. 11058:
Optics for Arts, Architecture, and Archaeology VII
Haida Liang; Roger Groves; Piotr Targowski, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?