SC-LSTM Based Human Action Recognition

Human Action Recognition is one of the most applied research directions in the field of Computer Vision, which is widely used in human-computer interaction, Augmented Reality (AR) technology, security monitoring, and other scenarios. However, due to the complexity of human action gestures, existing Human Action Recognition methods have certain deficiencies in dealing with variable human gestures and action information, and the accuracy needs to be improved. To improve the accuracy, We propose a multi-dimensional network model based on SC-LSTM(Skip-Connection + LSTM). First, a Temporal Feature Extraction Module is designed based on SC-LSTM, and a Spatial Feature Extraction Module is designed based on CNN and Multi-Attention Mechanism to extract potential human action features from both temporal and spatial dimensions, respectively. Then, a separate SC-LSTM classification network is utilized to process these spatio-temporal features to obtain the final HAR results. The experimental results show that compared to other algorithms, the present model can more fully utilize the information in the temporal dimension, and thus performs better in terms of HAR accuracy.