Automatic 3D city construction system using omni camera

Video analysis and mixed reality (MR) systems, which integrate the virtual world and the real world, are important topics of multimedia research. The authors propose an efficient 3D city construction system from omni video data as a practical application of MR systems. To develop this system, two main methods are proposed for analyzing omni video data. The first one is omniEPI analysis, which makes it possible to obtain 3D information from omni video data robustly and efficiently. The second method is omniPVI analysis, which makes it possible to obtain not only frontal images of the buildings but also side images of them. To demonstrate the effectiveness of these methods, we present some experimental results and the prototype systems using outdoor environment omni video data.