Smart: A Sensor-Triggerred Interactive Mr Display

To increase the user experience in mixed reality (MR) applications, researchers proposed to display virtual objects in mirrors and transmissive mirror devices. For example, [1] proposed to detect the moving object hold by a user in the real world and display the smoke virtual visual effect in a mirror with an MR experience. On the other hand, [2] developed the MRsionCase to display the text information near the static sculpture. In recently years, researchers paid attention to display the virtual contents in head-mount-display (HMD) devices. To name a few, [3] proposed to use a VR keyboard model with MR real hands to enhance an immersive experience. Furthermore, [4] proposed to use an Ultrahaptics to generate a sensing experience on a finger of a user in an MR application. However, to represent consistent displaying effect from a virtual space to a real space (the physical world) is still a challenging research issue. In this paper, a prototype with a hologram display is developed as an interactive MR device, triggered by the sensor values on mobile devices to change the attitude of a virtual object in the virtual world and the real object in a physical world with a synchronizing manner.