New algorithms for unconstrained nonlinear optimal control problems

A family of new first-order algorithms for solving continuous time optimal control problems is presented. The algorithms make use of the Riccati matrix differential equation and are capable of solving the linear quadratic problem in one step. The paper includes an analysis of the convergence of the proposed algorithms in the space of relaxed controls, as well as the proof of the reduction of the cost functional at each iteration and numerical examples.