EEG-based Evaluation on Intuitive Gesture Interaction in Virtual Environment

Bi-manual interaction in virtual reality (VR) is generally used and has unlimited potential in interdisciplinary fields such as health care, education, and industry due to the facts of its conveniences, intuition, and beyond. With the continuous development of these interfaces, passive monitoring of user state can play a key role in extending the immersive VR manual experience and tracking activities for user well-being. To date, research on investigation immersive and intuitive manual experience has mostly conducted in questionnaire. It may have several disadvantages such as differences in understanding and interpretation or hard to convey feelings and emotions. However,when using VR devices, physiological signals, such as electroencephalograms (EEG), are recorded, the interaction of the user in the virtual environment can be adjusted in real time according to the cognitive state of the user. The current VR headset provides a logical, convenient, and non-obtrusive framework for mounting EEG sensors. The study evaluates the feasibility of passively monitoring cognitive work loads via EEG during classical gesture tasks in the interactive VR environment. Data were collected from 15 participants and the EEG features were analyzed with respect to task performance. The results indicate that participants feel more intuitive and relaxed when using Vive wands in the virtual environment but the Leapmotion has the great potential for providing immersive experience.