Sparse MP4

MP4 is currently the gold standard for video compression. Here we demonstrate that MP4 can be augmented by using a spatiotemporal sparse code optimized for the reconstruction of video portraits to up-sample data streams in which 75% of the pixels have been removed. Lossless MP4 can then be used to transmit the decimated video stream, yielding additional compression via a hybrid algorithm we refer to as Sparse MP4. We report that when compared with standard MP4 tuned for a similar overall compression ratio, Sparse MP4 achieves significantly higher PSNR and similar SSIM scores.