Share Email Print

Proceedings Paper

Polymodal information processing via temporal cortex Area 37 modeling
Author(s): James K. Peterson
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

A model of biological information processing is presented that consists of auditory and visual subsystems linked to temporal cortex and limbic processing. An biologically based algorithm is presented for the fusing of information sources of fundamentally different modalities. Proof of this concept is outlined by a system which combines auditory input (musical sequences) and visual input (illustrations such as paintings) via a model of cortex processing for Area 37 of the temporal cortex. The training data can be used to construct a connectionist model whose biological relevance is suspect yet is still useful and a biologically based model which achieves the same input to output map through biologically relevant means. The constructed models are able to create from a set of auditory and visual clues a combined musical/ illustration output which shares many of the properties of the original training data. These algorithms are not dependent on these particular auditory/ visual modalities and hence are of general use in the intelligent computation of outputs that require sensor fusion.

Paper Details

Date Published: 12 April 2004
PDF: 12 pages
Proc. SPIE 5421, Intelligent Computing: Theory and Applications II, (12 April 2004); doi: 10.1117/12.540423
Show Author Affiliations
James K. Peterson, Clemson Univ. (United States)

Published in SPIE Proceedings Vol. 5421:
Intelligent Computing: Theory and Applications II
Kevin L. Priddy, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?