By Topic

Fluctuation analysis of a two-layer backpropagation algorithm used for modeling nonlinear memoryless channels

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

6 Author(s)
Bershad, N.J. ; Dept. of Electr. & Comput. Eng., California Univ., Irvine, CA, USA ; Ibnkahla, M. ; Blauwens, G. ; Cools, J.
more authors

Neural networks have been used to model the nonlinear characteristics of memoryless nonlinear channels using the backpropagation learning (BP) with experimental training data. The mean transient and convergence behavior of a simplified two-layer neural network has been studied previously in order to better understand this neural network application. The network was trained with zero mean Gaussian data. This paper extends these results to include the effects of the weight fluctuations on the mean square error (MSE). A new methodology is presented that can be extended to other nonlinear learning problems. The new mathematical model is able to predict the MSE learning behavior as a function of the algorithm step size μ. The performance analysis is based on the derivation of linear recursions for the variance and covariance of the weights that depend nonlinearly on the mean weights. These linear recursions can be used to predict the local mean-square stability of the weights. As in linear gradient search problems (LMS, etc.), it is shown that there exists an optimum p (minimizing the MSE), which is the result of the tradeoff between fast learning and small weight fluctuations. Monte Carlo simulations display excellent agreement between the actual behavior and the predictions of the theoretical model over a wide range of μ values

Published in:

Signal Processing, IEEE Transactions on  (Volume:47 ,  Issue: 5 )