Architecture for Orchestrating Dynamic DNN-Powered Image Processing Tasks in Edge and Cloud Devices

DNN processing on image streams has opened the possibility for new and innovative applications. Some of those would benefit from performing the computation locally, avoiding incurring into latencies due to data travelling to image processing services in the cloud, and thus allowing for faster response times. New devices like the GPU-accelerated NVIDIA Jetson family, such as the Jetson Nano, are capable of running modern DNN image processing models, offering an affordable, powerful and scalable local alternative to cloud processing. Performing local image processing can also benefit security and even GDPR compliance, potentially easing the deployment of this solutions. Not only that, but local image processing can also bring the possibility of applying these techniques in areas with reduced connectivity, where cloud-based solutions are unfeasible. In this work, we propose an architecture for the orchestration of DNN accelerated image processing on IoT devices, based on FogFlow; an orchestration platform capable of leveraging cloud and edge resources. FogFlow is part of the FIWARE initiative and is based in the NGSI family of standards, widely applied in Smart City, Smart Building and Smart Home solutions, making it an easy-to-integrate technology.