By Topic

Fluctuation analysis of a two-layer backpropagation algorithm used for modelling nonlinear memoryless channels

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

6 Author(s)
Bershad, N.J. ; Dept. of Electr. & Comput. Eng., California Univ., Irvine, CA, USA ; Ibnkahla, M. ; Blauwens, G. ; Cools, J.
more authors

Neural networks have previously been used for modelling the nonlinear characteristics of memoryless nonlinear channels using the backpropagation learning (BP) with experimental training data (Ibnkahla et al. 1997). The mean transient and convergence behavior of a simplified two-layer neural network have also been studied (Bershad et al. 1997). The network was trained with zero mean Gaussian data. This paper extends these results to include the effects of the weight fluctuations upon the mean-square-error (MSE). A new methodology is presented which can be extended to other nonlinear learning problems. The new mathematical model is able to predict the MSE learning behavior as a function of the algorithm step size /spl mu/. Linear recursions are derived for the variance and covariance of the weights which depend nonlinearly upon the mean weights. As in linear gradient search problems (LMS, etc.), there exists an optimum /spl mu/ (minimizing the MSE) which is the trade-off between fast learning and small weight fluctuations. Monte Carlo simulations display excellent agreement with the theoretical predictions for various /spl mu/.

Published in:

Signals, Systems & Computers, 1998. Conference Record of the Thirty-Second Asilomar Conference on  (Volume:1 )

Date of Conference:

1-4 Nov. 1998