Enhancing Sign Language Recognition Through LSTM Model

Sign language recognition is a remarkable task in this project completed through two state-of-the-art methods, Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU). This way, the system is able to quickly process each frame of the webcam with real-time information regarding face, body and posture in order to extract critical values. this research seeks to provide the necessary resources and opportunities for deaf people to be able to communicate effectively, obtain an education and enjoy their lives as much as other human beings This makes it a very important tool for education where the system can convert sign motions into text on-the-fly. The data was collected through a live camera, and key points from face, body, and pose were detected for training the model. Kindergarten used the four categories of vegetables, fruits, colors and animals. There were 40 video sequences of 40 frames with a sign in each. the model tries to fit too much to noisy points of data. However comprehensive the training, after 19 epochs the validation accuracy is an impressive 93%. The oscillations in the truth values of models are indicative of some uncertainty in learning where the accuracy is still to be settled. The graph in general shows that the LSTM based sign language movement classifier has a good capacity to learn and identify sign language movements with high precision.