A User-Perspective View for Mobile AR Systems Using Discrete Depth Segmentation

In this paper we present a methodology for creating a user-perspective view for mobile augmented reality (AR) systems. The most common video-see-through style for mobile AR systems is a device-perspective view, and the methods suggested for user-perspective rendering that are geometrically correct are very computationally expensive on current off-the-shelf devices. Based on this fact, we propose a real-time method which displays AR images according to the user's viewpoint by separating parts of the scene based on depth segmentation, and superimposing them as layers which gives the user a sense of motion parallax. With this paper, a prototype implementation on a desktop configuration is presented, accompanied by experimental results.