Share Email Print

Proceedings Paper

Semiotics and agents for integrating and navigating through multimedia representations of concepts
Author(s): Dan W. Joyce; Paul H. Lewis; Robert H. Tansley; Mark R. Dobie; Wendy Hall
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

The purpose of this paper is two-fold. We begin by exploring the emerging trend to view multimedia information in terms of low-level and high-level components; the former being feature-based and the latter the 'semantics' intrinsic to what is portrayed by the media object. Traditionally, this has been viewed by employing analogies with generative linguistics. Recently, a new perceptive based on the semiotic tradition has been alluded to in several papers. We believe this to be a more appropriate approach. From this, we propose an approach for tackling this problem which uses an associative data structure expressing authored information together with intelligent agents acting autonomously over this structure. We then show how neural networks can be used to implement such agents. The agents act as 'vehicles' for bridging the gap between multimedia semantics and concrete expressions of high-level knowledge, but we suggest that traditional neural network techniques for classification are not architecturally adequate.

Paper Details

Date Published: 23 December 1999
PDF: 12 pages
Proc. SPIE 3972, Storage and Retrieval for Media Databases 2000, (23 December 1999); doi: 10.1117/12.373542
Show Author Affiliations
Dan W. Joyce, Univ. of Southampton (United Kingdom)
Paul H. Lewis, Univ. of Southampton (United Kingdom)
Robert H. Tansley, Univ. of Southampton (United Kingdom)
Mark R. Dobie, Univ. of Southampton (United Kingdom)
Wendy Hall, Univ. of Southampton (United Kingdom)

Published in SPIE Proceedings Vol. 3972:
Storage and Retrieval for Media Databases 2000
Minerva M. Yeung; Boon-Lock Yeo; Charles A. Bouman, Editor(s)

© SPIE. Terms of Use
Back to Top