User Gaze-Driven Adaptation of Omnidirectional Video Delivery Using Spatial Tiling and Scalable Video Encoding

Omnidirectional video is becoming increasingly popular among viewers, but its delivery requires considerable amount of network bandwidth. Today’s streaming services are transmitting the full spatial angle of omnidirectional videos, although most of the transmitted content is not utilized. Due to both limited bandwidth availability and its dynamic fluctuations, adaptive delivery solutions play a key role in supporting high user quality streaming of omnidirectional videos. This paper describes research which extends the MPEG-DASH Spatial Relationship Description by adding scalable video encoding to spatial tiling. It proposes a novel tile-layering based gaze adaptation algorithm for omnidirectional video delivery and employs it in conjunction with multiple tiling schemes. The benefits of the proposed algorithm with diverse tiling schemes are evaluated objectively in terms of bandwidth savings and adaptation latency. The results show a reduction of network bandwidth requirements to about 30% of the original bandwidth value with a low processing latency of 70.87ms.