Full Body Tracking System based on Valve Lighthouse for Dance and Fitness Training with Real-time Scoring Feedback

This paper proposes a dance and fitness training system for real-time motion capture, streaming, simulation, comparison with a pattern motion, and generating scoring feedback for users. The system uses Valve Lighthouse full-body tracking technology to capture the positions of the user’s key joints in real time and compare them with pre-recorded standard movements. The main functions of the system include real-time feedback for overall motion evaluation and playback functions to help users to improve their motion performance efficiently. The experimental results show that the score based on dynamic time warping measure of users who completely imitate the standard movement is significantly lower and the change is smooth, which verifies the reliability of the system in the movement comparison and feedback.