Distributed display approach using PHMD with infrared camera

The aim of this study is to explore the feasibility of multiple display environment technology in the real world. In this paper, the wearable projector, with an infrared camera and light source, is used in combination with retro-reflective screens. The visible image and infrared light are projected to the screen and reflected back to the user's eye and the infrared camera. The screen location and the user's fingertip position are calculated using image processing to enable the interaction. Several examples or demonstrations have been constructed to show the usage of this configuration. The screen functions as both the visible screen and the high-gain infrared marker at the same time. Owing to high-reflection gain of retro-reflective screens, a small, lightweight projector can be used. Also, the high contrast between the screen and the other environmental object in the captured infrared image decreases the difficulty of image processing.