Loading web-font TeX/Math/Italic
SAC-ABR: Soft Actor-Critic based deep reinforcement learning for Adaptive BitRate streaming | IEEE Conference Publication | IEEE Xplore

SAC-ABR: Soft Actor-Critic based deep reinforcement learning for Adaptive BitRate streaming


Abstract:

Adaptive Bit Rate (ABR) assignment plays a crucial role for ensuring satisfactory quality of experience (QoE) in video streaming applications. Recently the authors of [1]...Show More

Abstract:

Adaptive Bit Rate (ABR) assignment plays a crucial role for ensuring satisfactory quality of experience (QoE) in video streaming applications. Recently the authors of [1] proposed to use reinforcement learning (RL) based asynchronous advantage actor-critic (A3C), an on-policy method, Pensieve, to improve ABR algorithms. It has shown to achieve a higher QoE as compared to other traditional ABR methods. However, Pensieve is sample inefficient and frail to different random seeds and hyperparameters. In this paper, we present soft actor-critic based deep reinforcement learning for adaptive bitrate streaming (SAC-ABR), an off-policy method, which improves the QoE as compared to other existing state-of-the-art ABR algorithms under a wide variety of network conditions. Based on the maximum entropy RL framework, SAC-ABR aims to maximize entropy while maximizing the expected rewards, hence achieving a better exploration-exploitation tradeoff as compared to on-policy ABR methods. We present the overall design together with the training and testing results of SAC-ABR, and evaluate its performance as compared to other state-of-the-art ABR algorithms. Our results show that SAC-ABR provides up to 27.42% higher average QoE as compared to Pensieve and much higher QoE when compared to other traditional fixed-rule based ABR algorithms.
Date of Conference: 04-08 January 2022
Date Added to IEEE Xplore: 13 January 2022
ISBN Information:

ISSN Information:

Conference Location: Bangalore, India

Funding Agency:

No metrics found for this document.

I. Introduction

The Global Internet Phenomena Report 2021 [2] uncovers that almost 80% of web traffic consists of video, gaming and social media content. Among them, at least 51 % of video streams are transmitted using adaptive bit rate video streaming methods [3]. On an average, every Internet user spends around seven hours per week watching videos on the web and therefore, there is a constant user demand for better video streaming quality. Studies have shown that users rapidly leave video sessions if the quality is not adequate, resulting in income losses for the content suppliers.

Usage
Select a Year
2025

View as

Total usage sinceJan 2022:746
051015202530JanFebMarAprMayJunJulAugSepOctNovDec61132420000000
Year Total:46
Data is updated monthly. Usage includes PDF downloads and HTML views.
Contact IEEE to Subscribe

References

References is not available for this document.