Dynamic Resource Allocation for Multi-Beam Satellite Communication Systems

Multi-beam satellite communication systems have been received widespread attention due to their high throughput and efficient resource utilization. In this paper, we investigate the beam illumination and resource allocation problem in multi-beam satellite communication systems. By jointly considering user position and service characteristics, an optics-based initial user grouping algorithm is proposed. To enhance beam coverage performance, a minimum circle algorithm is proposed to optimally design satellite beam positions and coverage radius. Given the obtained user grouping strategy, we address the difference between random user service demands and service provisioning capability of the system, and define system cost function. The joint beam illumination, sub-channel and power allocation problem is formulated as a system cost function minimization problem. To solve the formulated optimization problem, we introduce aggregate nodes to describe the characteristics of user groups, and address the beam illumination and power allocation problem of user groups. The problem is modeled as a mixed-space Markov decision process (MDP), and a parameterized deep Q-network-based joint beam illumination and power allocation algorithm is proposed. Based on the obtained resource allocation strategy for user groups, we then design user-oriented sub-channel and power allocation strategy. To this end, we model the optimization problem as an MDP and propose a double deep Q-network (DDQN) algorithm-based algorithm. To address the concern that the DDQN algorithm may reach a local optimum, proximal policy optimization algorithms with discrete action space and continuous action space are proposed. Simulation results validate the effectiveness of the proposed algorithms.