Share Email Print

Proceedings Paper

Auditory-visual interaction: from fundamental research in cognitive psychology to (possible) applications
Author(s): Armin Kohlrausch; Steven van de Par
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

In our natural environment, we simultaneously receive information through various sensory modalities. The properties of these stimuli are coupled by physical laws, so that, e.g., auditory and visual stimuli caused by the same even have a fixed temporal relation when reaching the observer. In speech, for example, visible lip movements and audible utterances occur in close synchrony which contributes to the improvement of speech intelligibility under adverse acoustic conditions. Research into multi- sensory perception is currently being performed in a great variety of experimental contexts. This paper attempts to give an overview of the typical research areas dealing with audio-visual interaction and integration, bridging the range from cognitive psychology to applied research for multimedia applications. Issues of interest are the sensitivity to asynchrony between audio and video signals, the interaction between audio-visual stimuli with discrepant spatial and temporal rate information, crossmodal effects in attention, audio-visual interactions in speech perception and the combined perceived quality of audio-visual stimuli.

Paper Details

Date Published: 19 May 1999
PDF: 11 pages
Proc. SPIE 3644, Human Vision and Electronic Imaging IV, (19 May 1999); doi: 10.1117/12.348440
Show Author Affiliations
Armin Kohlrausch, IPO Ctr. for Research on User-System Interaction and Philips Research Labs. (Netherlands)
Steven van de Par, IPO Ctr. for Research on User-System Interaction (Netherlands)

Published in SPIE Proceedings Vol. 3644:
Human Vision and Electronic Imaging IV
Bernice E. Rogowitz; Thrasyvoulos N. Pappas, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?