Dynamic User Demand Driven Online Network Selection

Network selection plays a key role in reaping the potential benefit of heterogeneous wireless networks. Aiming at improving the user's quality of experience, we study the network selection problem with time-varying user demand and non-uniform network handoff costs in a dynamic environment. One appealing solution in converging the time-vary user demand and the diverse network performance is dynamic network selection, which, however, poses the dilemma between satisfying user demand and controlling the network handoff cost. To get around this problem, we propose an online network selection algorithm to learn the optimal network selection policy with network handoff cost consideration. In addition, we exploit the inherent dependency in the problem and derive another two algorithms with much faster convergence speed. Simulations reveal that the proposed algorithms can achieve 10%~ performance gain over existing methods.