Predicting XR Services QoE with ML: Insights from In-band Encrypted QoS Features in 360-VR

The growing popularity of eXtended Reality (XR) is being driven by technological advancements and the demand for advanced immersive digital experiences, including the vision around the metaverse. Within the XR realm, 360-degree immersive video streaming is essential for Virtual Reality (VR) adventures and experiences. The use of E2E encryption for content delivery in 360-VR streaming poses challenges for network operators, making it difficult to manage their networks and assess potential Quality of Experience (QoE) impairments, specifically in 5G and beyond networks. Therefore, we propose a Machine Learning (ML) approach for inferring 360-VR video QoE metrics from network-level encrypted traffic. Our solution uses packet-level information for feature engineering, which serves as input for the ML model to predict target QoE estimators. We evaluate our solution using real 4G and 5G drive test traces with encrypted VR traffic using HTTPS and QUIC protocols. The experimental results show that the trained ML model yields reasonable accuracy with minimal residual error in predicting target VR QoE for both HTTPS and QUIC. Network operators can use such a model to passively monitor the real-time QoE of encrypted VR video sessions and optimize network performance.

I. Introduction

Video streaming is currently a dominant force in Internet traffic growth. Recent advancements in networking and multimedia technologies are bringing increased attention to Virtual Reality (VR), specifically 360-degree immersive video streaming. As an integral part of eXtended Reality (XR) services, VR is considered a key technology in this field. Reports predicted that VR-associated traffic would increase 12-fold by 2022, and the number of VR headsets (a.k. a., Head-mounted Displays or HMDs) in use is expected to reach 34 million by 2024. The potential economic impact of VR is significant, with projections of a 1.5 trillion boost to the global economy by 2030. ¹

Cisco VNI - forecast and trends, 2017–2022: Cisco, 2018

²

VR headset unit sales worldwide from 2019 to 2024: Thomas Alsop, 2022

³

Seeing is believing: PWC tech report, 2019