By Topic

Statistical analysis of the single-layer backpropagation algorithm with bias terms: mean weight behavior

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

2 Author(s)
Bershad, N.J. ; Dept. of Electr. & Comput. Eng., California Univ., Irvine, CA, USA ; Shynk, J.J.

This paper analyzes the perceptron mean weight learning behavior for a system identification model with Gaussian input training data and fixed non zero biases for both the perceptron and the unknown system. The analysis is based upon the partial evaluation of certain expectations using Price's (1958) theorem followed by numerical integration in the mean weight recursions. The mean weight vector is shown to be in the same direction as that of the unknown system. A scalar recursion is derived for the length of the mean weights. The recursion is shown to yield weight vector predictions that are in close agreement with Monte Carlo simulations of the perceptron learning behavior. The stationary points are also accurately predicted by the theoretical model

Published in:

Acoustics, Speech, and Signal Processing, 1996. ICASSP-96. Conference Proceedings., 1996 IEEE International Conference on  (Volume:6 )

Date of Conference:

7-10 May 1996