A quality framework for user interaction in virtual environments using wearable devices

Gesture recognition has been considered as one of the most effective input methods to interact with virtual environments (VEs). The skeleton tracking techniques which have been widely used for gesture recognition purposes showed common accuracy issues with Micro-gestures that can affect user's enjoyment. In this paper, we propose a multimodal interaction technique and test it using a designed wearable head-mounted tracker as a measurement instrument. We also designed a theoretical framework to resolve the weaknesses of Micro-Gestures recognition in CAVE (Cave Automatic Virtual Environment). The effectiveness of proposed method and its impact of user's joyfulness has been tested by a 3D gesture-based interface. The results showed improvement in user's enjoyment using the designed measuring and input method for navigation within a 3D CAVE by improving system's accuracy.