A multimodal quality assessment of compressed materials for adaptive bitrate video streaming

The paper describes experimental study of Quality of Experience of compressed audiovisual materials when the bandwidth available is changing. We propose a model of QoE multimodal assessment for audiovisual programs of various contents and in a wide range of compressed video and audio data bitrates. On the basis of the model an optimization problem of audio and video bit rate allocation in bandwidth-limited systems can be solved. The approach proposed is based on a cross-modal audiovisual interaction and takes into account that optimal audio and video codec parameters in bandwidth-limited multimedia systems can be content-adaptive.