Share Email Print

Proceedings Paper

Evolution programs for Bayesian training of neural networks
Author(s): Lemuel R. Myers; John G. Keller; Steven K. Rogers; Matthew Kabrisky
Format Member Price Non-Member Price
PDF $14.40 $18.00

Paper Abstract

In this paper, it is shown that Evolution Programs can be used to search the weight space for Bayesian training of a Neural Network. Bayesian Analysis is an integration problem (as opposed to an optimization problem) over weight space. The first application of the Bayesian method primarily focused on using a Gaussian approximation of the posterior distribution in an area of high probability in the weight space instead of using formal integration. More recently, training a neural network in a Bayesian fashion has been accomplished by searching weight space for areas of high probability density which obviates the need for the Gaussian assumption. In particular, a hybrid Monte-Carlo method was used to search weight space in a logical manner to obtain an arbitrarily close approximation of the integration involved in a Bayesian analysis. Genetic Algorithms have been used in the past to determine the weights in an ANN, and (with some slight modifications) are ideally suited for searching the weight space to approximate the Bayesian integration. In this respect, the Bayesian framework provides a simple and elegant way to apply Evolution Programs to the ANN training problem. While this paper concentrates on using ANNs as classifiers, the generalization to regression problems is straightforward.

Paper Details

Date Published: 25 March 1998
PDF: 9 pages
Proc. SPIE 3390, Applications and Science of Computational Intelligence, (25 March 1998); doi: 10.1117/12.304793
Show Author Affiliations
Lemuel R. Myers, Air Force Institute of Technology (United States)
John G. Keller, Air Force Institute of Technology (United States)
Steven K. Rogers, Battelle Memorial Institute (United States)
Matthew Kabrisky, Air Force Institute of Technology (United States)

Published in SPIE Proceedings Vol. 3390:
Applications and Science of Computational Intelligence
Steven K. Rogers; David B. Fogel; James C. Bezdek; Bruno Bosacchi, Editor(s)

© SPIE. Terms of Use
Back to Top