Collaborative Cloud-Edge Service Cognition Framework for DNN Configuration Toward Smart IIoT

With the widespread application of artificial intelligence and the Internet of Things, the intellectualization of the industrial Internet of Things (IIoT) has received more and more attention. However, in the application scenario with numerous sensors, the contradiction between massive requests of computing tasks and high requirements of inference quality affects the operation efficiency and service reliability. Moreover, due to the heterogeneity of computing resources and the randomness of communication environments of the cloud-edge system, how to compute and deploy deep learning models in a cloud-edge collaborative environment has also become a challenging problem. Therefore, this article presents a collaborative cloud-edge service cognitive framework for deep neural network (DNN) model service configuration to provide dynamic and flexible computing services. In order to adapt to different service requirements, we explored the tradeoffs between accuracy, latency, and energy consumption indicators, and a revenue target is established, which considers the quality of service experience and the system energy consumption to improve resource utilization efficiency. By transforming the optimization of the revenue target into a partially observable DNN configuration reinforcement learning problem, a dueling deep Q-learning network-based self-adaptive DNN configuration algorithm is proposed. Experimental results show that the proposed mechanism can effectively learn from external experience, adapt to the dynamic network environment, and reduce delay and energy consumption while meeting the service requirements.