On approximate policy iteration for continuous-time systems

We propose a new algorithm for feedback nonlinear synthesis. The algorithm computes suboptimal solutions, with bounds on suboptimality, to the Hamilton-Jacobi-Bellman equation. For systems that are modeled with polynomials the computations can be done efficiently via semidefinite programming. To illustrate the strength of the proposed method, we compute smooth stabilizing feedback controllers for several problems.