A region based multiple frame-rate tradeoff of video streaming

Conventional frame rate up-conversion adopted in low bit-rate video coding/streaming cannot obtain good quality due to artifacts caused by composition problems. In this paper, a region based multiple frame-rate tradeoff scheme is proposed to reduce artifacts. The video frames are divided into regions of interest (ROIs) and backgrounds by the visual attention model. The motion intensity and complexity of ROI and background are computed by perceptive motion energy spectrum (PMES) to decide the ratio of the frame rate of ROI to that of background. The background is encoded at a low frame rate, and up-converted to the same frame rate as ROI at the decoder, with an integrated background motion composition model. The experimental results indicate that, compared to conventional frame rate up-conversion and normal codec scheme without frame rate up-conversion at the same bandwidth, the proposed scheme has higher PNSR performance and better subjective visual quality.