Online Partial Offloading and Task Scheduling in SDN-Fog Networks With Deep Recurrent Reinforcement Learning

Smart industries enabling automation and data exchange in manufacturing technologies demanding real-time processing, nearby storage, and reliability, all of which can be satisfied by the fog computing architecture. With the emergence of smart devices coupled with a diverse range of application requirements, it is essential to have an intelligent fog network where intelligence is spread across all network segments, taking network nodes self-aware and self-decision making. In fog networks, an optimal distribution decision faces challenges due to uncertainties associated with user workload and available resources at the fog nodes and also the wide range of node’s computing power. Given this challenge, a computational offloading and CPU resource scheduling method for minimizing energy consumption is proposed. To investigate the characteristics for offloading and optimizing their allocation, we consider two types of tasks, namely, offloadable and nonoffloadable tasks. The independent fog nodes adopt the same strategy without prior knowledge of the dynamic statistics and global observations, aiming to maximize a common goal with cooperative behaviors. Then, the deep recurrent
$Q$
-network (DRQN) is applied to deal with the partial-observability from limited information. The proposed DRQN-based method requires comparatively less computational complexity than the conventional
$Q$
-learning algorithm. The simulation results show that the proposed method can effectively deal with both transmission and CPU energy consumptions while guaranteeing convergence in a limited time.