On the application of iterative dynamic programming to singular optimal control problems

The convergence properties of an iterative dynamic programming algorithm are examined by considering a singular optimal control problem involving five differential equations. Even with a relatively coarse grid, convergence to the optimal control policy is rapid. The procedure is easy to program, and the computations can be easily done on a personal computer.<
>