Discrete-Time Optimal Control via Local Policy Iteration Adaptive Dynamic Programming | IEEE Journals & Magazine | IEEE Xplore

Discrete-Time Optimal Control via Local Policy Iteration Adaptive Dynamic Programming


Abstract:

In this paper, a discrete-time optimal control scheme is developed via a novel local policy iteration adaptive dynamic programming algorithm. In the discrete-time local p...Show More

Abstract:

In this paper, a discrete-time optimal control scheme is developed via a novel local policy iteration adaptive dynamic programming algorithm. In the discrete-time local policy iteration algorithm, the iterative value function and iterative control law can be updated in a subset of the state space, where the computational burden is relaxed compared with the traditional policy iteration algorithm. Convergence properties of the local policy iteration algorithm are presented to show that the iterative value function is monotonically nonincreasing and converges to the optimum under some mild conditions. The admissibility of the iterative control law is proven, which shows that the control system can be stabilized under any of the iterative control laws, even if the iterative control law is updated in a subset of the state space. Finally, two simulation examples are given to illustrate the performance of the developed method.
Published in: IEEE Transactions on Cybernetics ( Volume: 47, Issue: 10, October 2017)
Page(s): 3367 - 3379
Date of Publication: 18 July 2016

ISSN Information:

PubMed ID: 27448382

Funding Agency:


References

References is not available for this document.