Piano learning application with feedback provided by an AR virtual character

This paper proposes a mobile application that uses Augmented Reality to enhance the experience of learning to play keyboard instruments. The proposed application uses Google Cardboard to let users visualize a virtual character and instructions. The character gives the user real-time visual feedback according to their music playing performance as evaluated by the system. This application lets users choose among pre-defined songs that can be learned and practiced by using a simplified notation that eliminates the barrier of using actual musical notation. Having in mind the psychological benefits of music learning, we aim to present a fun and easy way to learn music and keep the users' motivation during the process.