Abstract:
Emerging mobile virtual reality (VR) systems are required to continuously perform complex computer vision tasks needing computational power that is excessive for mobile d...Show MoreMetadata
Abstract:
Emerging mobile virtual reality (VR) systems are required to continuously perform complex computer vision tasks needing computational power that is excessive for mobile devices. Thus, techniques based on wireless edge computing (WEC) have been recently proposed. However, existing WEC methods require the transmission and processing of a high amount of video data which may ultimately saturate the wireless link. In this paper, we propose a novel sensing-assisted edge computing (ISAC-EC) approach to address this issue. ISAC-EC leverages knowledge about the physical environment to reduce the end-to-end latency and overall computational burden by transmitting to the edge server only the relevant data for the delivery of the service. Our intuition is that the transmission of the portion of the video frames where there are no changes with respect to the previous frames can be avoided. Through wireless sensing, only the part of the frames where any environmental change is detected is transmitted and processed. We evaluated ISAC-EC by using a 10K 360°camera with a Wi-Fi 6 sensing system operating at 160 MHz and performing localization and tracking. Experimental results show that ISAC-EC reduces both the channel occupation and end-to-end latency by more than 90% while improving the instance segmentation and object detection performance with respect to state-of-the-art WEC approaches. For reproducibility purposes, we pledge to share our dataset and code repository.
Published in: 2024 20th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob)
Date of Conference: 21-23 October 2024
Date Added to IEEE Xplore: 04 December 2024
ISBN Information: