By Topic

Reflections on the Numerical Solution of Markov Chains

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

1 Author(s)
Stewart, W.J. ; Dept. of Comput. Sci., North Carolina State Univ., Raleigh, NC, USA

It has been 45 years since Vic Wallace introduced RQA1, the first software system to generate and then compute the stationary distribution of Markov chains. RQA1 proved successful for a period of time but eventually hit upon a type of problem that it just could not solve, namely a nearly-completely-decomposable (NCD) Markov chain. In the intervening years our understanding of NCD systems has grown immensely which in turn has lead to the development of numerical techniques specifically designed for, and very effective at, solving such problems. An examination of the history of solving Markov chains over the years since shows that this phenomenon continues to this day. Problems that are not amenable to resolution by existing methods arise often unexpectedly; they are subsequently analyzed and give rise to the development of novel solution procedures. The application of Markov chains to model and analyze emerging technology - the development of search engines such as Google comes to mind - is particularly prone to creating such problems/opportunities. The paper examines how problems concerning generating state spaces, storing huge matrices and analyzing their composition have lead to important theoretical and practical results.

Published in:

Quantitative Evaluation of Systems (QEST), 2010 Seventh International Conference on the

Date of Conference:

15-18 Sept. 2010