By Topic

Weight decay and resolution effects in feedforward artificial neural networks

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$33 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

2 Author(s)
D. B. Mundie ; Dept. of Electr. Eng., Vanderbilt Univ., Nashville, TN, USA ; L. W. Massengill

Results are presented from a preliminary study on the effects of weight decay and resolution on the performance of typical three-layer, feedforward neural networks. Two types of decay are investigated, unilateral decay toward the most negative weight (unipolar) and bilateral decay toward the median or zero weight value (bipolar), and compared with Gaussian weight perturbations. This analysis is pertinent to the area of VLSI-based network implementations with analog weight storage. The results show that, if weight decay is unavoidable, bipolar decay achieves an order-of-magnitude better performance than unipolar and that the weight resolution required in actual implementations of feedforward, connectionist hardware is higher than predicted by computer simulations of network responses to random or Gaussian weight perturbations

Published in:

IEEE Transactions on Neural Networks  (Volume:2 ,  Issue: 1 )