By Topic

A Two-Phase Gauss-Seidel Algorithm for the Stationary Solution of EVMDD-Encoded CTMCs

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$33 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

2 Author(s)
Yang Zhao ; Dept. of Comput. Sci. & Eng., Univ. of California, Riverside, Riverside, CA, USA ; Gianfranco Ciardo

We present a new symbolic approach for the steady-state solution of ergodic continuous-time Markov chains(CTMCs) using iterative methods, based on Edge-Valued Multi-way Decision Diagrams (EVMDDs) to store an indexing function for the structured states and the transition rate matrix. The approach is applicable to any structured CTMC, is memory efficient, and supports both Jacobi and Gauss-Seidel iterations. In particular, our main contribution is a new two-phase algorithm to perform Gauss-Seidel iterations with a reduced decision diagram traversal overhead (a cost also encountered by Kronecker-based approaches). Then, we show how even better speedup can be achieved through a caching scheme. The complexity of our algorithm is linear in the number of nonzero entries in the transition rate matrix, and, even more importantly, it is independent of the number L of submodels in which the CTMC is decomposed under most common conditions. This is an improvement over previous structured methods, which are plagued by this L factor in practice. The advantages of our algorithm are supported by experimental results and a comparison with the tool PRISM.

Published in:

Quantitative Evaluation of Systems (QEST), 2012 Ninth International Conference on

Date of Conference:

17-20 Sept. 2012