Share Email Print
cover

Proceedings Paper

Integration of camera and range sensors for 3D pose estimation in robot visual servoing
Author(s): Carol C. Williams Hulls; William J. Wilson
Format Member Price Non-Member Price
PDF $14.40 $18.00

Paper Abstract

Range-vision sensor systems can incorporate range images or single point measurements. Research incorporating point range measurements has focused on the area of map generation for mobile robots. These systems can utilize the fact that the objects sensed tend to be large and planar. The approach presented in this paper fuses information obtained from a point range measurement with visual information to produce estimates of the relative 3D position and orientation of a small, non-planar object with respect to a robot end- effector. The paper describes a real-time sensor fusion system for performing dynamic visual servoing using a camera and a point laser range sensor. The system is based upon the object model reference approach. This approach, which can be used to develop multi-sensor fusion systems that fuse dynamic sensor data from diverse sensors in real-time, uses a description of the object to be sensed in order to develop a combined observation-dependency sensor model. The range- vision sensor system is evaluated in terms of accuracy and robustness. The results show that the use of a range sensor significantly improves the system performance when there is poor or insufficient camera information. The system developed is suitable for visual servoing applications, particularly robot assembly operations.

Paper Details

Date Published: 9 October 1998
PDF: 12 pages
Proc. SPIE 3523, Sensor Fusion and Decentralized Control in Robotic Systems, (9 October 1998); doi: 10.1117/12.326989
Show Author Affiliations
Carol C. Williams Hulls, Univ. of Waterloo (Canada)
William J. Wilson, Univ. of Waterloo (Canada)


Published in SPIE Proceedings Vol. 3523:
Sensor Fusion and Decentralized Control in Robotic Systems
Paul S. Schenker; Gerard T. McKee, Editor(s)

© SPIE. Terms of Use
Back to Top