Vision-based Virtual Touch Screen Interface

To utilize the augmented reality with the portable environment, human-computer interaction interface that satisfies the mobility, the convenience, as well as the accuracy is required. In this paper, we propose a vision-based virtual touch screen interface that ensures the requirements. The virtual touch screen is implemented on a stereo cameras installed see-through head mounted display device using an adaptive gesture recognition algorithm. Since it provides a natural way to interact with computers through the vision-based select, click, and drag&drop operations, it can be applied to various augmented reality environments without the restriction of the mobility and the inconvenience.