Signal Reconstruction from Partial Frequency Coefficients for Image/Video Frame Upsampling

In multimedia processing area, image/video frame resizing is recognized as one of the key techniques and has received more and more attention from the research community. It is necessary and very challenging for image/video distribution systems to be able to generate higher resolution video to meet high-end users' requirements. In this paper, we analyze the bottleneck of hybrid DCT-Wiener scheme firstly and propose a w-norm signal reconstruction scheme from partial frequency coefficients for upsampling based on uncertainty principles. In the proposed scheme, we design a w-norm model to reconstruct up-sized image/video frames by solving convex optimization with constraints. The proposed scheme combines Wiener filter with compressive sensing (CS) theory seamlessly to automatically control the accuracy of both low- and high-frequency components. This scheme can efficiently avoid the fake contours and ringing effects which are the main defects of hybrid DCT-Wiener methods (hybrid methods). Experiments have been carried out to demonstrate that the proposed scheme can achieve significant PSNR and SSIM gains over typical CS schemes and original hybrid method. On the other hand, the proposed scheme controls the accuracy of both low- and high-frequency components by calculating the correlation between reconstructed signals and sampling matrixes during reconstruction which is a good solution to reduce fake contours and ringing effect. This scheme can also achieve noticeable visual quality improvement compared with hybrid methods and typical CS methods.