Dynamic Resource Allocation of Delay Sensitive Users Using Interactive Learning over Multi-Carrier Networks

In this paper, we study distributed solutions for joint power-spectrum resource allocation among delay sensitive users over multi-carrier networks. Our work differs from prior research in two ways. First, unlike prior works that only consider the impact of effective throughput of a user, our work also considers the source traffic characteristics of applications and applies queuing analysis to quantify the packet transmission delay, which is especially important to a delay sensitive user. Secondly, most prior works focus on the equilibrium of the decentralized solutions that usually require global information in a static network. Instead, we focus on interactive adaptation methods for users to dynamically maximize their expected utility based on the local observed information. We propose an interactive learning framework for users to adapt their power/channel selection to the wireless networks with interference coupling among users. Our simulation results show that the proposed interactive learning approach with information exchange among users improves the total utility significantly.