Share Email Print
cover

Proceedings Paper

High-resolution optimal quantization for stochastic pooling networks
Format Member Price Non-Member Price
PDF $14.40 $18.00

Paper Abstract

Pooling networks of noisy threshold devices are good models for natural networks (e.g. neural networks in some parts of sensory pathways in vertebrates, networks of mossy fibers in the hippothalamus, . . . ) as well as for artificial networks (e.g. digital beamformers for sonar arrays, flash analog-to-digital converters, rate-constrained distributed sensor networks, . . . ). Such pooling networks exhibit the curious effect of suprathreshold stochastic resonance, which means that an optimal stochastic control of the network exists. Recently, some progress has been made in understanding pooling networks of identical, but independently noisy, threshold devices. One aspect concerns the behavior of information processing in the asymptotic limit of large networks, which is a limit of high relevance for neuroscience applications. The mutual information between the input and the output of the network has been evaluated, and its extremization has been performed. The aim of the present work is to extend these asymptotic results to study the more general case when the threshold values are no longer identical. In this situation, the values of thresholds can be described by a density, rather than by exact locations. We present a derivation of Shannon's mutual information between the input and output of these networks. The result is an approximation that relies a weak version of the law of large numbers, and a version of the central limit theorem. Optimization of the mutual information is then discussed.

Paper Details

Date Published: 3 January 2007
PDF: 15 pages
Proc. SPIE 6417, Complexity and Nonlinear Dynamics, 641706 (3 January 2007); doi: 10.1117/12.695984
Show Author Affiliations
Mark D. McDonnell, The Univ. of Adelaide (Australia)
Pierre-Olivier Amblard, Lab. des Images et des Signaux, CNRS (France)
Nigel G. Stocks, The Univ. of Warwick (United Kingdom)
Steeve Zozor, Lab. des Images et des Signaux, CNRS (France)
Derek Abbott, The Univ. of Adelaide (Australia)


Published in SPIE Proceedings Vol. 6417:
Complexity and Nonlinear Dynamics
Axel Bender, Editor(s)

© SPIE. Terms of Use
Back to Top