We derive two second-order algorithms, based on the conjugate gradient method, for online training of recurrent neural networks. These algorithms use two different techniques to extract second-order information on the Hessian matrix without calculating or storing it and without making numerical approximations. Several simulation results for nonlinear system identification tests by locally recurrent neural networks are reported for both the off-line and online case
Published in:
Neural Networks Proceedings, 1998. IEEE World Congress on Computational Intelligence. The 1998 IEEE International Joint Conference on
(Volume:1
)
Date of Conference: 4-8 May 1998