Multimodal Physiological Analysis of Cognition and the Correlations with Emotion in VR

During VR cognitive rehabilitation, user performance in cognitive tasks is influenced by their emotional states. However, most current research primarily focuses on emotional valence, lacking a comprehensive examination of the impact of emotions on cognitive activities and their underlying physiological mechanisms based on an arousal-valence dimensional model. To address this gap, we have conducted an experiment in which participants are induced with four distinct emotions using VR videos, followed by cognitive tasks. Concurrently, we collect participants’ EEG, ECG, and GSR signals. The results indicate that high arousal and high valence emotional states significantly improve user performance in cognitive tasks (shorter reaction times).