Share Email Print

Proceedings Paper

Advanced time-of-flight range camera with novel real-time 3D image processing
Author(s): Bernhard Koenig; Bedrich Hosticka; Peter Mengel; Ludwig Listl
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

We present a solid state range camera covering measuring distances from 2 m to 25 m and novel real-time 3D image processing algorithms for object detection, tracking and classification based on the three-dimensional features of the camera's output data. The technology is based on a 64x8 pixel array CMOS image sensor which is capable of capturing three-dimensional images by executing indirect time-of-flight (ToF) measurement of NIR laser pulses emitted by the camera and reflected by the objects in the cameras field of view. Here the so-called "multiple double short time integration" (MDSI) method enables unprecedented reliability and robustness with respect to suppression of background irradiance and insensitiveness to reflectivity variations in the object scene. Output data are conventional intensity values and distance values with accuracies in the centimeter range at image repetition rates up to 100 Hz. An evaluation of the camera's performance in typical road safety related test scenarios is subject of this paper. Furthermore we introduce real-time image processing of the output data stream of the camera aiming at the segmentation of objects being located in the camera's surrounding and the derivation of reliable position, speed and acceleration estimates. The segmentation algorithm utilizes the position information of all three spatial dimensions as well as the intensity values and thus yields significant segmentation improvement compared to segmentation in conventional 2D pictures. Position, velocity and acceleration values of the segmented objects are estimated by means of Kalman filtering in 3D space. The filter is dynamically adapting to the measurement conditions to take care of changes of the scene data properties. Flow and performance of the whole processing chain are presented by means of example scenes.

Paper Details

Date Published: 20 September 2007
PDF: 11 pages
Proc. SPIE 6695, Optics and Photonics for Information Processing, 66950D (20 September 2007); doi: 10.1117/12.732078
Show Author Affiliations
Bernhard Koenig, Siemens AG (Germany)
Bedrich Hosticka, Fraunhofer Institute of Microelectronic Circuits and Systems (Germany)
Peter Mengel, Siemens AG (Germany)
Ludwig Listl, Siemens AG (Germany)

Published in SPIE Proceedings Vol. 6695:
Optics and Photonics for Information Processing
Abdul A.S. Awwal; Khan M. Iftekharuddin; Bahram Javidi, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?