Share Email Print

Proceedings Paper

Using virtual 3D audio in multispeech channel and multimedia environments
Author(s): Michael D. Orosz; Walter J. Karplus; Jerry D. Balakrishnan
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

The advantages and disadvantages of using virtual 3-D audio in mission-critical, multimedia display interfaces were evaluated. The 3D audio platform seems to be an especially promising candidate for aircraft cockpits, flight control rooms, and other command and control environments in which operators must make mission-critical decisions while handling demanding and routine tasks. Virtual audio signal processing creates the illusion for a listener wearing conventional earphones that each of a multiplicity of simultaneous speech or audio channels is originating from a different, program- specified location in virtual space. To explore the possible uses of this new, readily available technology, a test bed simulating some of the conditions experienced by the chief flight test coordinator at NASA's Dryden Flight Research Center was designed and implemented. Thirty test subjects simultaneously performed routine tasks requiring constant hand-eye coordination, while monitoring four speech channels, each generating continuous speech signals, for the occurrence of pre-specified keywords. Performance measures included accuracy in identifying the keywords, accuracy in identifying the speaker of the keyword, and response time. We found substantial improvements on all of these measures when comparing virtual audio with conventional, monaural transmissions. We also explored the effect on operator performance of different spatial configurations of the audio sources in 3-D space, simulated movement (dither) in the source locations, and of providing graphical redundancy. Some of these manipulations were less effective and may even decrease performance efficiency, even though they improve some aspects of the virtual space simulation.

Paper Details

Date Published: 28 August 2000
PDF: 11 pages
Proc. SPIE 4022, Cockpit Displays VII: Displays for Defense Applications, (28 August 2000); doi: 10.1117/12.397743
Show Author Affiliations
Michael D. Orosz, Univ. of California/Los Angeles (United States)
Walter J. Karplus, Univ. of California/Los Angeles (United States)
Jerry D. Balakrishnan, Purdue Univ. (United States)

Published in SPIE Proceedings Vol. 4022:
Cockpit Displays VII: Displays for Defense Applications
Darrel G. Hopper, Editor(s)

© SPIE. Terms of Use
Back to Top