Multimodal Behavior Analysis for Virtual Reality Learning Environment

Since 2020, the e-Iearning systems have been accepted by more and more people. However, it is important to acquire the learning state of all online learners in real time. A research framework for addressing situational understanding in teaching and learning environments is proposed, which integrated multimodal data to recognize learning states based on behavior analyses. As a case study, the research framework is applied for a virtual reality learning environment. The experimental results show the usage of this research to achieve situational understanding and aid decision-making for online teaching and learning.