Share Email Print

Proceedings Paper

Advanced human machine interaction for an image interpretation workstation
Author(s): S. Maier; M. Martin; F. van de Camp; E. Peinsipp-Byma; J. Beyerer
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

In recent years, many new interaction technologies have been developed that enhance the usability of computer systems and allow for novel types of interaction. The areas of application for these technologies have mostly been in gaming and entertainment. However, in professional environments, there are especially demanding tasks that would greatly benefit from improved human machine interfaces as well as an overall improved user experience. We, therefore, envisioned and built an image-interpretation-workstation of the future, a multi-monitor workplace comprised of four screens. Each screen is dedicated to a complex software product such as a geo-information system to provide geographic context, an image annotation tool, software to generate standardized reports and a tool to aid in the identification of objects. Using self-developed systems for hand tracking, pointing gestures and head pose estimation in addition to touchscreens, face identification, and speech recognition systems we created a novel approach to this complex task. For example, head pose information is used to save the position of the mouse cursor on the currently focused screen and to restore it as soon as the same screen is focused again while hand gestures allow for intuitive manipulation of 3d objects in mid-air. While the primary focus is on the task of image interpretation, all of the technologies involved provide generic ways of efficiently interacting with a multi-screen setup and could be utilized in other fields as well. In preliminary experiments, we received promising feedback from users in the military and started to tailor the functionality to their needs

Paper Details

Date Published: 12 May 2016
PDF: 8 pages
Proc. SPIE 9851, Next-Generation Analyst IV, 985105 (12 May 2016); doi: 10.1117/12.2223565
Show Author Affiliations
S. Maier, Fraunhofer-Institut für Optronik, Systemtechnik und Bildauswertung (Germany)
M. Martin, Fraunhofer-Institut für Optronik, Systemtechnik und Bildauswertung (Germany)
F. van de Camp, Fraunhofer-Institut für Optronik, Systemtechnik und Bildauswertung (Germany)
E. Peinsipp-Byma, Fraunhofer-Institut für Optronik, Systemtechnik und Bildauswertung (Germany)
J. Beyerer, Fraunhofer-Institut für Optronik, Systemtechnik und Bildauswertung (Germany)

Published in SPIE Proceedings Vol. 9851:
Next-Generation Analyst IV
Barbara D. Broome; Timothy P. Hanratty; David L. Hall; James Llinas, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?