Share Email Print

Proceedings Paper

Integration of language and sensor information
Author(s): Leonid I. Perlovsky; Bertus Weijers
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

The talk describes the development of basic technologies of intelligent systems fusing data from multiple domains and leading to automated computational techniques for understanding data contents. Understanding involves inferring appropriate decisions and recommending proper actions, which in turn requires fusion of data and knowledge about objects, situations, and actions. Data might include sensory data, verbal reports, intelligence intercepts, or public records, whereas knowledge ought to encompass the whole range of objects, situations, people and their behavior, and knowledge of languages. In the past, a fundamental difficulty in combining knowledge with data was the combinatorial complexity of computations, too many combinations of data and knowledge pieces had to be evaluated. Recent progress in understanding of natural intelligent systems, including the human mind, leads to the development of neurophysiologically motivated architectures for solving these challenging problems, in particular the role of emotional neural signals in overcoming combinatorial complexity of old logic-based approaches. Whereas past approaches based on logic tended to identify logic with language and thinking, recent studies in cognitive linguistics have led to appreciation of more complicated nature of linguistic models. Little is known about the details of the brain mechanisms integrating language and thinking. Understanding and fusion of linguistic information with sensory data represent a novel challenging aspect of the development of integrated fusion systems. The presentation will describe a non-combinatorial approach to this problem and outline techniques that can be used for fusing diverse and uncertain knowledge with sensory and linguistic data.

Paper Details

Date Published: 1 April 2003
PDF: 8 pages
Proc. SPIE 5099, Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2003, (1 April 2003); doi: 10.1117/12.501839
Show Author Affiliations
Leonid I. Perlovsky, Air Force Research Lab. (United States)
Bertus Weijers, Air Force Research Lab. (United States)

Published in SPIE Proceedings Vol. 5099:
Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2003
Belur V. Dasarathy, Editor(s)

© SPIE. Terms of Use
Back to Top