Share Email Print

Proceedings Paper • Open Access

FPGA-based lens undistortion and image rectification for stereo vision applications
Author(s): Christina Junger; Albrecht Heß; Maik Rosenberger; Gunther Notni

Paper Abstract

Lens undistortion and image rectification is a commonly used pre-processing, e.g. for active or passive stereo vision to reduce the complexity of the search for matching points. The undistortion and rectification is implemented in a field programmable gate array (FPGA). The algorithm is performed pixel by pixel. The challenges of the implementation are the synchronisation of the data streams and the limited memory bandwidth. Due to the memory constraints, the algorithm utilises a pre-computed lossy compression of the rectification maps by a ratio of eight. The compressed maps occupy less space by ignoring the pixel indexes, sub-sampling both maps, and reducing repeated information in a row by forming differences to adjacent pixels. Undistorted and rectified images are calculated once without and once with the compressed transformation map. The deviation between the different computed images is minimal and negligible. The functionality of the hardware module, the decompression algorithm and the processing pipeline are described. The algorithm is validated on a Xilinx Zynq-7020 SoC. The stereo setup has a baseline with 46 mm and non-converged optical axis between the cameras. The cameras are configured at 1.3 Mpix @ 60 fps and distortion correction and rectification is performed in real time during image capture. With a camera resolution of 1280 pixels × 960 pixels and a maximum vertical shift of ± 20 pixels, the efficient hardware implementation utilizes 12 % of available block RAM resources.

Paper Details

Date Published: 17 September 2019
PDF: 8 pages
Proc. SPIE 11144, Photonics and Education in Measurement Science 2019, 1114416 (17 September 2019); doi: 10.1117/12.2530692
Show Author Affiliations
Christina Junger, Technische Univ. Ilmenau (Germany)
Albrecht Heß, Technische Univ. Ilmenau (Germany)
Maik Rosenberger, Technische Univ. Ilmenau (Germany)
Gunther Notni, Technische Univ. Ilmenau (Germany)
Fraunhofer Institute for Applied Optics and Precision Engineering (Germany)

Published in SPIE Proceedings Vol. 11144:
Photonics and Education in Measurement Science 2019
Maik Rosenberger; Paul-Gerald Dittrich; Bernhard Zagar, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?