Machine learning Scheme for Managing Virtual Computing Resources in Cloud Market

Cloud provider can maximize his profit while guaranteeing quality of service (QoS) required by clients. In this work, we propose new scheme for maximizing cloud provider profit while guaranteeing QoS for clients. Cloud provider (CP) manages all available resources on cloud market. The key objective of our scheme is extracting the optimal charging strategy for serving clients requests to maximize CP's profit by choosing proper set of requests to be served, subject to uncertain demand of service and time-varying service cost. As variety of clients classes submit their requests and offer different prices for service, this problem deserves special treatment. To tackle the uncertain service prices, Q-Iearning is proposed to extract the optimal charging policy. Numerical results show that the proposed scheme can improve the reward of CP significantly.