Joint Resource Allocation in Cloud-Edge-Terminal Integrated IIoT: A Lyapunov-Guided PDQN Approach

In order to meet the stringent requirements on the latency and energy consumption, a cloud-edge-terminal integrated architecture for IIoT is first proposed. In view of the dynamics in the generation of tasks and wireless environment, an optimization problem on maximizing the long-term latency satisfaction rate is formulated under energy constraint. To tackle this multi-stage stochastic problem, a joint resource allocation algorithm of communicating-computing-caching is proposed based on Lyapunov-guided parameterized DQN. Compared with DQN and DDPG based algorithms, the proposed algorithm improves the latency satisfaction rate by 16.9% and 27.7%, and reduces the energy consumption by 29.0% and 33.7%, respectively.