By Topic

Controlled Markov chains with risk-sensitive exponential average cost criterion

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$33 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

2 Author(s)
A. Brau ; Dept. of Math., Arizona Univ., Tucson, AZ, USA ; E. Fernandez-Gaucherand

In this paper we are concerned with the exponential risk-sensitive version of the standard average cost criterion for controlled Markov chains (CMC). Our presentation is mathematically rigorous, and our proof techniques are self-contained and perhaps somewhat intuitive. Furthermore, we extend some previous results to the countable state space case. In addition, we consider optimization within the general set of randomized policies, and not only within the restricted class of Markovian deterministic policies. We model risk sensitivity as being given by an exponential disutility function Uγ(x)=(sgnγ)eγx, where γ is the constant risk-sensitivity coefficient. After basic definitions and notation, the paper presents and briefly analyzes alternative definitions of the exponential average cost criterion (EAC). Howard and Matheson's definition of EAC (1972) is discussed in detail. Finally we show that, similarly to the risk-neutral case, the optimal EAC satisfies an optimality equation

Published in:

Decision and Control, 1997., Proceedings of the 36th IEEE Conference on  (Volume:3 )

Date of Conference:

10-12 Dec 1997