MRCoach: A Real-Time IoT-Enabled Mixed Reality System with Semantic-Aware Transmission for Smart Sports and Personalized Coaching

Real-time transmission of large-scale data, high computational demands, and resource limitations on edge devices pose significant challenges for intelligent sports systems. The proliferation of Internet of Things (IoT) technologies has catalyzed the rise of Smart Sport, where wearable sensors, cameras, and intelligent algorithms are integrated to revolutionize athletic training. Despite this transformation, access to professional coaching remains constrained by factors such as time, cost, and scalability. A critical limitation of existing remote coaching approaches is their inability to perform effective spatio-temporal analysis, hindering comprehensive evaluation and refinement of athletic performance. This paper introduces MRCoach, a mixed reality-based, immersive, and interactive sports coaching system that enables data-driven training without requiring in-person supervision. MRCoach reconstructs 3D volumetric avatars of both learners and expert athletes, allowing users to visualize and compare their movements side-by-side in a mixed reality environment for intuitive skill refinement. To ensure responsive and efficient feedback, we propose an adaptive semantic transmission strategy that prioritizes sport-relevant joints, thereby reducing latency and bandwidth requirements without sacrificing accuracy. Furthermore, a 3D sports analysis framework is developed to evaluate motion based on normalized joint positions, velocities, and accelerations. This framework computes real-time similarity scores and delivers actionable guidance to learners. Experimental results across four sports—tennis, soccer, basketball, and baseball—demonstrate MRCoach’s effectiveness in providing personalized, real-time training experiences. Compared to state-of-the-art baselines such as MagicStream, ExPose, and PIXIE, MRCoach achieves significantly lower end-to-end latency (79.9 ms) and higher frame rates (≥ 56 FPS), while maintaining accurate pose tracking and high avatar fidelity.