Federated Deep Recurrent Q-Learning for Task Partitioning and Resource Allocation in Satellite Mobile-Edge-Computing-Assisted Industrial IoT

Mobile edge computing (MEC) deploys servers at cellular base stations to provide computing services for Industrial Internet of Things (IIoT) applications. However, in remote areas lacking cellular coverage, traditional MEC systems are ineffective. The advancement of low-Earth orbit (LEO) satellite communication networks introduces satellite-based MEC, deploying servers on satellites, as a promising solution for remote areas. Yet, the limited resources for IIoT devices pose challenges for delivering low-latency computing services. In this article, we investigate the problem of task partitioning and resource allocation in satellite-assisted MEC systems, aiming to minimize the task completion latency of IIoT devices. Tasks can be divided into multiple subtasks executed by local IIoT devices, MEC servers, or cloud servers. The subtasks can be independent of or dependent on each other. A proposed approach based on deep recurrent
$Q$
-learning networks (DRQNs) utilizes recurrent neural networks to learn temporal features resulting from satellite movement and optimize accordingly. Given the difficulty in obtaining global state information in large-scale networks, federated learning (FL) is integrated into the DRQN framework to enhance efficient decision making by aggregating local models. The simulation validates the effectiveness of the proposed approach, demonstrating significant reductions in average latency.