Scheduling space-time dependent packets in multi-view video streaming

I formulate an optimization framework for scheduling the packet transmissions in streaming multi-view content over bandwidth constrained channels. The optimization allows me to compute the transmission decisions that maximize the expected reconstruction quality of the content at the client, for the given bandwidth resources. Two prospective multi-view content representation formats are considered: MVC and video plus depth. In the case of each, I formulate directed graph models that characterize the interdependencies between the data units comprising the content. For the video plus depth format, I develop a novel space-time error concealment strategy that reconstructs missing content at the client based on received data units from multiple views. I design two techniques for solving the optimization problem of interest. In conjunction, I derive a spatiotemporal model of the reconstruction error for the multi-view content that I employ to reduce the computational requirements of the optimization. I study the performance of my framework via simulation experiments. Significant gains in rate-distortion efficiency are observed over state-of-the-art methods.