Facilitating selection and travel tasks in virtual environments using a motion sensitive hand-held device

We describe in this paper several enhancements proposed in order to facilitate selection and travel tasks inside virtual environments (VEs) displayed on hand-held mobile devices. We build on previous results on motion detection and optical flow estimation as well as gesture recognition and gesture from motion using computer vision techniques. A system composed of a hand-held device equipped with a video camera and a simple motion recognition system is described with the main focus on selection and travel tasks inside VEs. The result is a natural and intuitive way for performing navigation as well as for selecting objects via simple movements and touch events. Movements of the device are mapped into travel actions such as scene translations and rotations or captured in the form of gestures for triggering additional commands.