By Topic

A New Method to Improve the Gradient Based Search Direction to Enhance the Computational Efficiency of Back Propagation Based Neural Network Algorithms

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$33 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

3 Author(s)
Nazri Mohd Nawi ; Fac. of Inf. Technol. & Multimedia, Univ. Tun Hussein Onn Malaysia, Batu Pahat ; Rajesh S. Ransing ; Meghana R. Ransing

Neural-network techniques, particularly back- propagation algorithms, have been widely used as a tool for discovering a mapping function between a known set of input and output examples. Neural networks learn from the known example set by adjusting its internal parameters, referred to as weights, using an optimisation procedure based on the 'least square fit principle'. The optimisation procedure normally involves thousands of iterations to converge to an acceptable solution. Hence, improving the computational efficiency of a neural- network algorithm is an active area of research. It has been shown in the existing literature that the variation of the gain parameter improves the learning efficiency of the gradient-descent method. However, it can be concluded from previous researchers' claims that the adaptive-gain variation improved the learning rate and hence the efficiency. It was discovered in this research that the gain variation has no influence on the learning rate; however, it actually influences the search direction. A novel technique of integrating the adaptive-learning rate method coupled with an improved search direction for improving the computational efficiency of neural networks is presented. The new approach had shown that this modification can significantly enhance the computational efficiency of training process.

Published in:

2008 Second Asia International Conference on Modelling & Simulation (AMS)

Date of Conference:

13-15 May 2008