Backhaul Aware User-Specific Cell Association Using Q-Learning

With the advent of network densification and the development of other radio interface technologies, the major bottleneck of future cellular networks is shifting from the radio access network to the backhaul. The future networks are expected to handle a wide range of applications and users with different requirements. In order to tackle the problem of downlink user-cell association, and allocate users to the best cell, an intelligent solution based on reinforcement learning is proposed. A distributed solution based on Q-Learning is developed in order to determine the best cell range extension offsets (CREOs) for each small cell (SC) and the best weights of each user requirement to efficiently allocate users to the most appropriate SC, based on both backhaul constraints and user demands. By optimizing both CREOs and user weights, a user-specific allocation can be achieved, resulting in a better overall quality of service. The results show that the proposed algorithm outperforms current solutions by achieving better user satisfaction, mitigating the total number of users in outage, and minimizing user dissatisfaction when satisfaction is not possible.