Enhancing AR/VR Performance via Optimized Edge-based Object Detection for Connected Autonomous Vehicles

The rapid integration of augmented reality (AR) and virtual reality (VR) technologies into contemporary automotive development has led to unprecedented opportunities and challenges. This work addresses the integration of edge computing and AR/VR applications within connected autonomous vehicles, focusing on the pivotal role of object detection. The edge-assisted object detection problem is formulated as a constrained optimization problem, aiming to minimize the adverse effects on the object detection process. To solve the problem, we introduce an innovative edge-assisted algorithm, transmitting live camera frames to an edge server for detailed processing. Only essential detection data is then relayed to AR/VR devices, marking a significant advancement over existing strategies. Notable outcomes include a reduction in latency (averaging between 37.06% and 44.76%), enhanced data throughput (ranging from 27.66% to 41.18%), improved freshness loss (between 36.36% and 69.57%), and a frame loss reduction to 7.5%, surpassing baseline methods by 6.5% to 36%. These findings underscore the potential of this methodology for optimizing AR/VR applications in vehicular environments.