Applying Hybrid Deep Learning Models to Assess Upper Limb Rehabilitation

Upper limb rehabilitation training is an effective method to restore and improve the upper limb motor function of stroke patients, which enables them to engage in daily life activities independently. However, traditional rehabilitation training methods have limitations such as high cost of rehabilitation equipment and imprecise assessment. Currently, Kinect is widely used to track key points of human skeleton, but Kinect is costly and requires high indoor environment, which makes it unsuitable for use in complex scenarios. In order to solve these problems, this study presents a new method that utilizes deep learning algorithms to recognize rehabilitation movements and thus evaluate rehabilitation effects. The proposed method is designed to help healthcare professionals monitor the patient’s rehabilitation progress and develop an optimal rehabilitation program for the patient. The method uses a monocular camera to capture video data from the patient’s upper limb rehabilitation training, utilizes Faster R-CNN and HRNet to recognize the human body position and upper limb bone key point information, and then builds a long short-term memory (LSTM) neural network model incorporating the ProbSparse Self-Attention mechanism to evaluate the rehabilitation training movements. The experimental results show that the accuracy of the proposed method in this study reaches 94.1%, and its overall performance is better than that of the baseline method in low-cost, high-precision and complex scenarios.