Stereo sequence analysis, compression, and virtual viewpoint synthesis

This paper considers the problem of structure and motion estimation in stereoscopic tele-conferencing type sequences and its application for stereo sequence compression and for intermediate view generation. Generally, this type of sequence consists of one or several foreground objects (head and shoulders) and a more or less static background. By extracting the foreground objects and investigating the relationship between right and left images, we can compress the image-pair by making use of the redundancy of the left and right image-pair. In the meantime, by using the estimated structure information, we ran generate virtual viewpoints between the left and right image-pair, which can be very helpful for tele-presence applications.