Computing MDP cost function for high speed networks with sample-path and quantization

In this paper, we apply two techniques to the cost computation in the networking problems. The sample-path-based performance potential theory removes the need of knowing the exact system parameters. Cost quantization, on the other hand, reduces the state space to a manageable size. Numerical results show that considerable computation efforts can be saved without degrading the performance significantly.