Wearable input/output interface for floor projection using hands and a toe

Wearable projection systems enable hands-free viewing via large projected screens, and eliminating the need to hold devices. These systems need a surface of projection and interaction. However, in case of choosing a wall as the projection surface, users have to be positioned in front of the wall when they wish to access information. In this paper, we propose a wearable input/output system composed of a mobile projector, a depth sensor and a gyro sensor. It allows user to conduct “select” and “drag” operation by footing and fingertips controlling in the projected image on floor. Also it can provide user more efficient GUI operations on floor with combining hand and toe input. To confirm advantage and limitations of the system, we conduct user study. Finally we suggest guidelines and identify some problems when designing an interface for the interaction between the hand/toe and the floor. We also suggest the input method which uses both a finger and a toe.