Enabling Urban MmWave Communications with UAV-Carried IRS via Deep Reinforcement Learning

Emerging 6G technologies, such as terahertz communication and ultra-massive multiple-input multiple-output, offer exciting prospects but face challenges like limited range and multipath interference. In this paper, we seek to use an unmanned aerial vehicle (UAV)-carried intelligent reflecting surface (IRS) to assist the terrestrial mmWave networks. Specifically, we consider a typical urban scenario where a UAV-carried IRS rebuilds the line of sight (LoS) channel between a mobile user and a base station under the existence of obstacles. Then, we formulate an optimization problem to maximize the transmission rates and minimize the UAV energy consumption, by jointly optimizing the UAV trajectory and the phase shifts of IRS. The problem is non-convex and with high dynamic, and thus we propose a deep reinforcement learning (DRL)-based algorithm with neural episodic control, long short-term memory (LSTM), and a phase control method to solve the problem, thereby enhancing the stability and accelerate convergence speed. Simulation results demonstrate that the proposed algorithm effectively addresses the problem and outperforms other benchmark algorithms.