Real-time rendering system of moving objects

We have been developing a system named "mutual tele-existence" which allows for face-to-face communication between remote users (Tachi et al., 1996). Although image-based rendering (IBR) is suitable for rendering human figures with a complex geometry, conventional IBR techniques cannot readily be applied to our system. Because most IBR techniques include time-consuming processes, they cannot capture the source images and simultaneously render the destination images. In this paper, we propose a novel method focusing on real-time rendering. Moreover, we introduce equivalent depth of field to measure the fidelity of the synthesized image. If the object is in this range, accurate rendering is guaranteed. Then, we introduce a prototype machine that has 12 synchronized cameras on the linear actuator. Finally, we present some experimental results of our prototype machine.