By Topic

Approximate solutions for large-scale piecewise deterministic control systems arising in manufacturing flow control models

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$33 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

1 Author(s)
C. van Delft ; Dept. Manage. Ind. et Logistique, Groupe HEC, Jouy-en-Josas, France

We propose a numerical technique for approximately solving large-scale piecewise deterministic control systems that are typically related to manufacturing flow control problems in unreliable production systems. The method consists of reformulating the stochastic control problem under study into a Markov decision process. Then we exploit the associated dynamic programming conditions and we propose an “approximate” policy iteration algorithm. This will be based on an approximation of the Bellman functions by a combination of a set of base functions, using a specific decomposition technique. The numerical method is applicable whenever a turnpike property holds for some associated infinite horizon deterministic control problem. To illustrate the approach, we solve an example and compare this new approximation method with a more classical approximation-by-decomposition technique

Published in:

IEEE Transactions on Robotics and Automation  (Volume:10 ,  Issue: 2 )