IRS-enabled Wireless Power Transfer and Data Collection in UAV-assisted IoT

An intelligent reflecting surface (IRS)-enabled wireless power transfer (WPT) and data collection scheme for unmanned aerial vehicle (UAV)-assisted Internet of Things (IoT) network is investigated in this paper. Specifically, IoT devices (IoTDs) first harvest energy from the UAV and then upload the sensed data by applying time-division multiple access (TDMA), where an IRS is deployed to improve the transmission quality. We aim to minimize the age of information (AoI) and energy consumption of the UAV. For achieving this, we formulate an optimization problem by jointly optimizing the UAV trajectory, IRS phase shits, charging time allocation, and binary IoTD scheduling, which is a mixed-integer non-convex optimization problem. To address the issue, we first formulate our problem into a Markov decision process (MDP) and then propose an alternating optimization-double parameterized deep Q-network (AO-DPDQN) approach to solve the optimization problem. Specifically, an AO-based method is adopted to optimize the phase shifts of IRS to simplify the action space of MDP, and then double parameterized deep Q-network (DPDQN) is employed to optimize UAV trajectory, charging time allocation, and IoTD scheduling. Simulation results demonstrate the effectiveness and superiority of the proposed approach compared to various baselines.