XR based Interaction: Leveraging on Virtual Digital Twin for Efficient Exploration with Small FOV Augmented Reality Glass

In this poster, we propose to take advantage of the digital twinned environment to interact more efficiently in spite of the limited sized FOV of the AR glasses. Using the digital twin of the environment, “magical” VR interaction techniques can be applied, as visualized and overlaid through the small window, while still maintaining the spatial association to the augmented real world. As an example, we consider the use of amplified movement within the corresponding VR space - in an attempt to provide effectively larger view with the same AR field of view but with less amount of physical movements. The results of the pilot experiment with the proposed method have in-dicated that the interaction performance was partly improved, while the spatial understanding with regards to the augmentation space maintained. The work illustrates the concept of and potential for XR based interaction where the user can leverage on the advantages of both VR and AR mode operations.