MDP-Based Handover In Heterogeneous Ultra-Dense Networks

A promising solution to achieve high spectral efficiency and to improve coverage and throughput in 5G cellular systems is the deployment of Heterogeneous Ultra-Dense Networks (H-UDN). However, a key challenge for H-UDN is to manage user mobility and handovers among the cells. In this paper, we propose using a Markov decision process based on the received signal strength. Based on the User Equipment (UE) location, the UE selects the most efficient handover scheme. However, having an H-UDN, the UE may receive the worse received signal. Hence, we introduce the Stackelberg competition model in order to increase the relay node to be selected. This will guarantee communication quality and the load balancing of the system. The simulation result shows that the UE selection of the station with the highest signal strength is based on the distance between the UE and the station and the transmitted power.