Mr. Piano: A Portable Piano Tutoring System

We present a portable piano-tutoring system that facilitates piano learning without the spatial limitations and unaffordable cost. Our proposed system is able to simultaneously project an interactive piano on the table while displaying a music sheet with animated instruction on the smartphone. By detecting the user's hand movements with our efficient approach, visual and sound feedbacks can be given in real time. Mr. Piano gives instructions and feedbacks that helps a beginner to learn fundamental piano skills. The user can play with demonstration, instruction, or practice mode with different level of instructions. Unlike other mobile piano-tutoring system, the key of our projected piano is equivalent in size to a standard one that makes users adjust themselves to play a actual piano better. The user evaluation shows our proposed system helps users to learn piano effectively.