A Surveillance Video Real-Time Analysis System Based on Edge-Cloud and FL-YOLO Cooperation in Coal Mine

Video monitoring is an important means to ensure production safety in coal mine. However, the currently intelligent video surveillance is difficult to respond in real-time due to the latency of cloud computing. In this paper, a cloud-edge cooperation framework is proposed, which integrates cloud computing and edge computing in a coordinated manner. The cloud computing is used to process non-real-time and global tasks, while the edge computing is responsible for handling local monitoring video in real-time. In order to realize cloud-edge data interaction and online optimization for edge models, the heterogeneous converged network is built. In addition, an object detection model FL-YOLO composed of depthwise separable convolution and down-sampling inverted residual block is proposed, which realizes real-time video analysis at the edge. Finally, this paper discusses the complexity of FL-YOLO by its computational cost and model size. The experiment results show that the model size of FL-YOLO is 16.1MB, which is very light, and it achieves 36.7 FPS on NVIDIA Jetson TX1 and an AP of 76.7% on Multi-scene pedestrian dataset. Comparing with mainstream object detection models, FL-YOLO completes faster detection speed and higher accuracy, and it has lower calculation complexity and smaller model scale. Furthermore, the AP on Single-scene pedestrian dataset of FL-YOLO is improved to 80.7% by cloud-edge cooperation. K-Fold method is also used to further compared the performance of FL-YOLO and other models. Moreover, system test is implemented on coal mine, which validates the actual engineering effect of the proposed cloud-edge cooperation framework.