Reconfigurable Intelligent Surface Aided Cellular Networks With Device-to-Device Users

Reconfigurable intelligent surface (RIS) technology is promising to enhance wireless communications services by providing smart radio environment. In this paper, we investigate the RIS aided cellular networks with device-to-device (D2D) users, and maximize the sum of the transmission rate of the D2D communications and the cellular networks from a new perspective. In addition to solving the typical resource allocation problems for D2D communications, this paper further optimize the wireless environment by adjusting the position and phase shift of the RIS. To solve this non-convex problem, we propose a novel decentralized double deep Q-network (D
³
QN) framework for the resource allocation at users and a centralized DDQN for RIS optimization at the base station (BS), which are verified to achieve the near-optimal performance with lower complexity and enhanced robustness. Simulation results illustrate that the proposed framework can achieve higher transmission rates compared to benchmarks, meanwhile meeting the quality of service (QoS) requirements at the BS and D2D users.