By Topic

Numerical Approximations for Optimal Controls for Stochastic Systems With Delays

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

1 Author(s)
Kushner, H.J. ; Appl. Math. Dept., Brown Univ., Providence, RI

The Markov chain approximation numerical methods are widely used to compute optimal value functions and controls for stochastic and deterministic systems. We extend them to controlled general nonlinear delayed reflected diffusion models. The path, control, and reflection terms can all be delayed. Previous work developed convergent numerical approximations. But when the control and reflection terms are delayed there are impossible demands on memory. An alternative "dual" approach was proposed by Kwong and Vintner for the linear deterministic system with a quadratic cost function. We extend it to the general nonlinear stochastic system, develop the Markov chain approximations and numerical algorithms, and outline the convergence theorems. The approach reduces the memory requirement significantly

Published in:

Decision and Control, 2006 45th IEEE Conference on

Date of Conference:

13-15 Dec. 2006