Low bandwidth remote rendering using 3D image warping

3D models are information rich and provide a compelling user experience. However the usually large file size restricts Internet use. In addition complex models are unsuitable for rendering on low-end mobile devices. This paper describes a framework, based on work by previous researchers, that addresses these problems. The client downloads an initial 2D image and pixel depth information. A new image, from a nearby viewpoint, is requested from a remote server. Meanwhile the client creates intermediate viewpoints by 3D warping the initial image. The server transmits a compressed, sparse 2D residual frame, calculated as the difference between a polygon rendered image and the image created by the 3D warp. The client adds this image to its own warped image to create a final image for display. We obtain compression results for several types of residual image and show warped images reconstructed using a small integer splat. Results show an effective compression ratio of around 5% as compared to a simpler image streaming system.