By Topic

Unsaturated MLP neural networks training algorithm using a piecewise error function and adaptive learning rates

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$33 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

2 Author(s)
Payman Moallem ; Electrical Engineering Department, Faculty of Engineering, University of Isfahan, Iran ; S. Arvin Ayoughi

Saturation conditions of the hidden layer neurons are a major cause of learning retardation in multilayer perceptrons (MLP). Under such conditions the traditional backpropagation (BP) algorithm is trapped in local minima. To renew the search for a global minimum, we need to detect the traps and an offset scheme to avoid them. We have discovered that the gradient norm drops to a very low value in local minima. Here, adding a modifying term to the standard error function enables the algorithm to escape the local minima. In this paper, we proposed a piecewise error function; i.e. where the gradient norm remained higher than a parameter we used the standard error function, and added a modifying term to the function below this value. To further enhance this algorithm, we used our proposed adaptive learning rate schema. We performed a selection of benchmark problems to asses the efficiency of our proposed algorithm. Compared to previously proposed algorithms, we recorded higher convergence rates, especially in complex problems with complex input-output mapping.

Published in:

Telecommunications, 2008. IST 2008. International Symposium on

Date of Conference:

27-28 Aug. 2008