Scheduled System Maintenance:
Some services will be unavailable Sunday, March 29th through Monday, March 30th. We apologize for the inconvenience.
By Topic

Analysis of the Desired-Response Influence on the Convergence of Gradient-Based Adaptive Algorithms

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

The purchase and pricing options are temporarily unavailable. Please try again later.
2 Author(s)
Vicente, L. ; Aragon Inst. for Eng. Res., Univ. of Zaragoza, Zaragoza ; Masgrau, Enrique

Although the convergence behavior of gradient-based adaptive algorithms, such as steepest descent and leas mean square (LMS), has been extensively studied, the influence of the desired response on the transient convergence has generally received little attention. However, empirical results show that this signal can have a great impact on the learning curve. In this paper we analyze the influence of the desired response on the transient convergence by making a novel interpretation, from the viewpoint of the desired response, of previous convergence analyses of SD and LMS algorithms. We show that, without prior knowledge that can be used to wisely select the initial weight vector, initial convergence is fast whenever there is high similarity between input and desired response whereas, on the contrary, when there is low similarity between these two signals, convergence is slow from the beginning.

Published in:

Circuits and Systems I: Regular Papers, IEEE Transactions on  (Volume:55 ,  Issue: 5 )