Share Email Print

Proceedings Paper

Sharing skills: using augmented reality for human-robot collaboration
Author(s): Bjorn Giesler; Peter Steinhaus; Marcus Walther; Ruediger Dillmann
Format Member Price Non-Member Price
PDF $14.40 $18.00

Paper Abstract

Both stationary 'industrial' and autonomous mobile robots nowadays pervade many workplaces, but human-friendly interaction with them is still very much an experimental subject. One of the reasons for this is that computer and robotic systems are very bad at performing certain tasks well and robust. A prime example is classification of sensor readings: Which part of a 3D depth image is the cup, which the saucer, which the table? These are tasks that humans excel at. To alleviate this problem, we propose a team approah, wherein the robot records sensor data and uses an Augmented-Reality (AR) system to present the data to the user directly in the 3D environment. The user can then perform classification decisions directly on the data by pointing, gestures and speech commands. After the classification has been performed by the user, the robot takes the classified data and matches it to its environment model. As a demonstration of this approach, we present an initial system for creating objects on-the-fly in the environment model. A rotating laser scanner is used to capture a 3D snapshot of the environment. This snapshot is presented to the user as an overlay over his view of the scene. The user classifies unknown objects by pointing at them. The system segments the snapshot according to the user's indications and presents the results of segmentation back to the user, who can then inspect, correct and enhance them interactively. After a satisfying result has been reached, the laser-scanner can take more snapshots from other angles and use the previous segmentation hints to construct a 3D model of the object.

Paper Details

Date Published: 21 May 2004
PDF: 8 pages
Proc. SPIE 5291, Stereoscopic Displays and Virtual Reality Systems XI, (21 May 2004); doi: 10.1117/12.526689
Show Author Affiliations
Bjorn Giesler, Univ. Karlsruhe (Germany)
Peter Steinhaus, Univ. Karlsruhe (Germany)
Marcus Walther, Univ. Karlsruhe (Germany)
Ruediger Dillmann, Univ. Karlsruhe (Germany)

Published in SPIE Proceedings Vol. 5291:
Stereoscopic Displays and Virtual Reality Systems XI
Mark T. Bolas; Andrew J. Woods; John O. Merritt; Stephen A. Benton, Editor(s)

© SPIE. Terms of Use
Back to Top