Linear Programming solvers for Markov Decision Processes

This paper describes linear programming solvers for Markov decision processes, as an extension to the JMDP program. JMDP is an object-oriented framework to model and solve Markov decision processes (MDP) programmed in Java. The developed solvers work for the discounted cost and average cost criteria. Our solvers are compared with existing value iteration and policy iteration solvers