Smartphone-Based Augmented Reality Systems

Augmented Reality (AR) is a technology that can integrate virtual information into real world in real time, and enhance the perception ability of reality. The research content in this paper is divided into two parts. One is tracking and registration of virtual objects, and the other is occlusion handling between real and virtual scenes in an AR system. For tracking and registration of virtual objects, gyroscope sensor feature in smartphone combined with feature detection and matching techniques in computer vision are employed to realize tracking and registration of virtual objects based on natural marks. For occlusion handling between real and virtual scenes, a user-defined depth layers method integrating with image segmentation technology is designed to handle AR occlusion on the smartphone. Experimental results show that the designed smartphone-based AR system can realize the real-time registration and occlusion handling between real world and virtual scene.