Convergence rate of moments in stochastic approximation with simultaneous perturbation gradient approximation and resetting

The sequence of recursive estimators for function minimization generated by Spall's (1998) simultaneous perturbation stochastic approximation (SPSA) method, combined with a suitable restarting mechanism is considered. It is proved that this sequence converges under certain conditions with rate O(n/sup -/spl beta//2/) for some /spl beta/>0, the best value being /spl beta/=2/3, where the rate is measured by the L/sub q/-norm of the estimation error for any 1/spl les/q