Super-resolution for inconsistent scalable video streaming

We propose an example-based super-resolution method for a new framework of scalable video streaming. The proposed method is applicable to scalable video where the enhancement layer of some frames (e.g., within the same Group-of-Pictures) might be dropped due to changing network conditions. This leads to a streaming scenario that we call Inconsistent Scalable Video (ISV) streaming. In this paper, we focus on spatial ISV. In particular, at the decoder, the frames with the enhancement layer are used as the super-resolution dictionary for other video frames that their enhancement layers were dropped. Using the proposed method, the frames with dropped enhancement layer are scaled up to the original size. Our experimental results show a clear improvement over traditional interpolation based scaling.