Development and Application of eTheremin: Hand Tracking and AI Technology Facilitate Educational and Entertaining Musical Training

The rapid advancement of digital technology and artificial intelligence is driving significant transformations in the fields of music education and creation. This study addresses the challenges and hardware limitations of the traditional Theremin by introducing an innovative virtual Theremin system (eTheremin). The system integrates gesture tracking technology (MediaPipe) with an AI-powered timbre generation model (NSynth). It offers intuitive pitch and volume control while incorporating local soundscapes to promote cultural heritage and seamlessly combine education with entertainment, creating a novel musical interface. The research focuses on three primary objectives: 1. Exploring the educational impact of the virtual Theremin on pitch training. 2. Evaluating the developmental potential of gesture-controlled systems for musical performance. 3. Analyzing the integration of local soundscapes for cultural promotion and application value. This study is currently underway. Through experimental testing and user feedback, it examines the system's stability, learning effectiveness, and user experience. The findings aim to establish a new design framework, providing fresh insights for the broader application of virtual instruments in music education and creative practices.