Develop Drama Performances Featuring Virtual Characters for Utilization in Language Learning

As VTubers rapidly grow, learning through virtual character role-play in language learning can integrate more deeply into educational contexts, offering a more effective alternative to traditional drama performances. To develop a more effortless and convenient system for multiplayer online virtual character role-play, this research aims to facilitate ubiquitous learning. This study has designed a virtual role-playing-based language conversation learning method and developed a Multiplayer Online Virtual Drama System (MOVDS). This system features four key functionalities: 1) a Cloud Data Module, 2) a Motion Capture Module, 3) Voice Recognition, and 4) a Synchronization Module with Networking. The system provides real-time role-playing capabilities by synchronizing the facial expressions of virtual characters with live actors. It realizes the creative presentation of dramatic scenarios through voice chat, text prompts, and animations. This innovative approach boosts performers' confidence and reduces the learners' anxiety and cognitive load associated with spoken expression, thereby enhancing users' foreign language conversation skills.