Almost sure rate of convergence of the parameter estimates in stochastic approximation algorithm

This paper presents novel results on the almost sure convergence of the parameter estimates in stochastic approximation algorithm. It is proved that this rate has the same order as the best one established for the least squares algorithm. Although we consider the case of self-tuning controllers, the presented results can easily be extended to some other adaptive processes.