Share Email Print

Proceedings Paper

Application of simulated annealing to the backpropagation model improves convergence
Author(s): Charles B. Owen; Adel M. Abunawass
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

The Backpropagation technique for supervised learning of internal representations in multi- layer artificial neural networks is an effective approach for solution of the gradient descent problem. However, as a primarily deterministic solution, it will attempt to take the best path to the nearest minimum, whether global or local. If a local minimum is reached, the network will fail to learn or will learn a poor approximation of the solution. This paper describes a novel approach to the Backpropagation model based on Simulated Annealing. This modified learning model is designed to provide an effective means of escape from local minima. The system is shown to converge more reliably and much faster than traditional noise insertion techniques. Due to the characteristics of the cooling schedule, the system also demonstrates a more consistent training profile.

Paper Details

Date Published: 19 August 1993
PDF: 8 pages
Proc. SPIE 1966, Science of Artificial Neural Networks II, (19 August 1993);
Show Author Affiliations
Charles B. Owen, Western Illinois Univ. (United States)
Adel M. Abunawass, Western Illinois Univ. (United States)

Published in SPIE Proceedings Vol. 1966:
Science of Artificial Neural Networks II
Dennis W. Ruck, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?