HMD-based virtual multi-screen control system and its gesture interface

This work presents a virtual multi-screen control system using head-mounted display (HMD) and its gesture interface. To create virtual space, a front camera which is attached on the HMD takes frames into the system. Then, several outer USB cameras takes each frame on each screen which is located in the virtual space. Gestures are recognized by the infrared (IR) sensor and the structure of hand is obtained by the IR information. Finally, a virtual space is rendered based on the field of view obtained through the sensor built in the HMD. To control the screens as a user interaction, the system adopts the several gestures as a control system.