Share Email Print

Proceedings Paper

Multi-modal interaction for robotics mules
Author(s): Glenn Taylor; Michael Quist; Matthew Lanting; Cory Dunham; Paul Muench
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

To lighten the load of dismounted infantry, research is being conducted into the use of “robotic mules” that can help carry equipment and supplies for small units as they conduct their operations. While autonomy and perception features of robotic systems are steadily improving, the way in which people interact with them is still fairly rudimentary. The operator control units (OCUs) for these robotic mules are typically hand-held gaming controllers for tele-operation, or worn ruggedized portable computers or tablets with point-and-click interfaces. These control devices add more weight to the operator, and often require them to hold the controllers in their hands and to spend considerable time looking down at the OCU screen to enter commands or to understand what the robot is doing. Furthermore, these interfaces often require specialized training to understand how to operate the OCUs. This paper describes research aimed at reducing the physical, cognitive, and training burdens that robotic systems place on operators above and beyond the their regular jobs as warfighters. We first present an analysis of relevant infantry communication to identify interaction requirements, and an analysis of technologies that might be used to support these interactions. We then describe a prototype heads-up, hands-free system for controlling robotic mules using a lightweight, worn interaction device that facilitates natural twoway interaction (including speech and gesture input) between the robotic mule and the user. We describe the challenges in building this system and some formative evaluations of the technology

Paper Details

Date Published: 5 May 2017
PDF: 9 pages
Proc. SPIE 10195, Unmanned Systems Technology XIX, 101950T (5 May 2017); doi: 10.1117/12.2262896
Show Author Affiliations
Glenn Taylor, Soar Technology, Inc. (United States)
Michael Quist, Soar Technology, Inc. (United States)
Matthew Lanting, Soar Technology, Inc. (United States)
Cory Dunham, Soar Technology, Inc. (United States)
Paul Muench, U.S. Army Tank Automotive Research, Development and Engineering Ctr. (United States)

Published in SPIE Proceedings Vol. 10195:
Unmanned Systems Technology XIX
Robert E. Karlsen; Douglas W. Gage; Charles M. Shoemaker; Hoa G. Nguyen, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?