A DQN-based Joint Spectrum and Computing Resource Allocation Algorithm for Multi-Service MEC Networks

This paper considers the network resource allocation problem in multi-service MEC networks, and in particular considers joint spectrum and computing resource allocation in an edge network service system. The resource allocation problem under consideration is formulated as an optimization problem, which takes into account users’ minimum service requirements in terms of the service delay, transmission rate, and computation rate, with an objective to minimize the average service delay of a user’s service request. To solve the problem, we propose a deep-Q-network (DQN) based joint spectrum and computing resource allocation algorithm, which attempts to optimize the resource allocation for each service request by learning a more efficient allocation scheme so as to better adapt to dynamic traffic arrivals, diverse service requirements, and complex environmental conditions. Simulation results show that the proposed resource allocation algorithm can efficiently reduce the average service delay compared with two benchmark algorithms.