Share Email Print
cover

Proceedings Paper

In-the-loop training algorithm for neural network implementation with digital weights
Author(s): Jinming Yang; Graham A. Jullien; Majid A. Ahmadi; W. C. Miller
Format Member Price Non-Member Price
PDF $14.40 $18.00

Paper Abstract

In this paper, we propose a training algorithm for VLSI neural networks with digital weights and analog neurons using in-the-loop training strategy. The use of digital weights in a neural network implementation imposes new issues that are not present in simulation environments. One of the problems is that a neural network implementation will not work properly when using the digitized version of the continuous weight solution. This phenomenon is especially evident when the digital weight resolution is very low due to some fabrication constraints. In this paper the training strategies for dealing with digital weights are investigated. The proposed training algorithm is by measuring the sensitivity of each weight to its error function and then by perturbing the weights of higher sensitivity values to perform retraining process. Our experimental results indicate that the algorithm is feasible and particularly suitable for the digital weights with low number of bits.

Paper Details

Date Published: 9 October 1998
PDF: 6 pages
Proc. SPIE 3517, Intelligent Systems in Design and Manufacturing, (9 October 1998); doi: 10.1117/12.326913
Show Author Affiliations
Jinming Yang, Univ. of Windsor (Canada)
Graham A. Jullien, Univ. of Windsor (Canada)
Majid A. Ahmadi, Univ. of Windsor (Canada)
W. C. Miller, Univ. of Windsor (Canada)


Published in SPIE Proceedings Vol. 3517:
Intelligent Systems in Design and Manufacturing
Bhaskaran Gopalakrishnan; San Murugesan, Editor(s)

© SPIE. Terms of Use
Back to Top