Scheduled System Maintenance:
On Monday, April 27th, IEEE Xplore will undergo scheduled maintenance from 1:00 PM - 3:00 PM ET (17:00 - 19:00 UTC). No interruption in service is anticipated.
By Topic

Control of Admission and Routing in Loss Networks: Hybrid Dynamic Programming Equations

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

3 Author(s)
Zhongjing Ma ; Center for Sustainable Syst. (CSS), Univ. of Michigan, Ann Arbor, MI, USA ; Caines, P.E. ; Malhame, R.P.

Call admission and routing control decisions in stochastic loss (circuit-switched) networks with semi Markovian, multi-class, call arrival and general connection time processes are formulated as optimal stochastic control problems. The resulting so-called Hybrid Dynamic Programming equation systems take the form of vectors of partial differential equations with each component associated to a distinct distribution of routed calls over the network (i.e. distinct occupation states). This framework reduces to that of a Markov Decision Process when the traffic is Poisson and the associated computational limitations are approximately those of linear programs. Examples are provided of (i) network state space constructions and controlled state transition processes, (ii) a new closed form solution for a simple network, and (iii) the analysis and illustrative numerical results for a three link network.

Published in:

Automatic Control, IEEE Transactions on  (Volume:55 ,  Issue: 2 )