CKN: An Edge AI Distributed Framework

The edge-cloud-HPC continuum is transformative for AI processing at the edge. With greater availability of both edge and cloud resources, AI inference, training, and optimization can be distributed across the continuum. We target edge-cloud in particular where the workload at the Edge server can exhibit discrete changes, for instance, when motion is detected. We optimize for Quality of Experience (QoE) and utilize historical data from the Edge, graphs, and Deep Learning to infer the next action to take. Using a large synthetic workload and publicly profiled inference models, our results show that predictive guidance outperforms random choice or best guess in optimal QoE of the edge-cloud continuum.