Share Email Print

Proceedings Paper

Interaction of perception and gaze control in autonomous vehicles
Author(s): Martin Pellkofer; Michael Luetzeler; Ernst Dieter Dickmanns
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

For robust and secure behavior in natural environment an autonomous vehicle needs an elaborate vision sensor as main source of information. The vision sensor must be adaptable to the external situation, the mission, the capabilities of the vehicle and the knowledge about the external world accumulated up to the present time. In the EMS-Vision system, this vision sensor consists of four cameras with different focal lengths mounted on a highly dynamic pan-tilt camera head. Image processing, gaze control and behavior decision interact with each other in a closed loop. The image processing experts specify so-called regions of attention (RoAs) for each object in 3D object coordinates. These RoAs should be visible with a resolution as required by the measurement techniques applied. The behavior decision module specifies the relevance of obstacles like road segments, crossings or landmarks in the situation context. The gaze control unit takes all this information in order to plan, optimize and perform a sequence of smooth pursuits, interrupted by saccades. The sequence with the best information gain is performed. The information gain depends on the relevance of objects or object parts, the duration of smooth pursuit maneuvers, the quality of perception and the number of saccades. The functioning of the EMS-Vision system is demonstrated in a complex and scalable autonomous mission with the UBM test vehicle VAMORS.

Paper Details

Date Published: 5 October 2001
PDF: 12 pages
Proc. SPIE 4572, Intelligent Robots and Computer Vision XX: Algorithms, Techniques, and Active Vision, (5 October 2001); doi: 10.1117/12.444186
Show Author Affiliations
Martin Pellkofer, Univ. der Bundeswehr Muenchen (Germany)
Michael Luetzeler, Univ. der Bundeswehr Muenchen (Germany)
Ernst Dieter Dickmanns, Univ. der Bundeswehr Muenchen (Germany)

Published in SPIE Proceedings Vol. 4572:
Intelligent Robots and Computer Vision XX: Algorithms, Techniques, and Active Vision
David P. Casasent; Ernest L. Hall, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?