Deep Learning Based Hand Gesture Recognition for Emergency Situation: A Study on Indian Sign Language

Sign Language is used to convey feelings and thoughts, as well as to reinforce information given in everyday discussions. The goal of Sign Language recognition is to recognize and comprehend important human body gestures. Deep learning is a subset of machine learning that has lately gained traction in the recognition of sign languages. The current research focuses on how deep learning may be used to solve the challenge of identifying hand gestures in a collection of videos for emergency situations. To feed the model, a number of frames were taken from the videos. A pre-trained VGG-16 and a recurrent neural network with a large short-term memory make up the model (RNN-LSTM). The model achieved an accuracy of 98% on an Indian Sign Language Dataset of Hand Gestures for Emergency Situations. Deaf people can use sign language as a kind of emergency communication to help them deal with these circumstances. In this study, sign recognition could be utilised to address circumstances like pain, calling for help, or having to see a doctor.

I. Introduction

Human-Computer Interaction (HCI) is an interdisciplinary study field that focuses on the design of computing technologies and human-computer interaction. It has been continually improved in recent years and is now extensively utilised in a variety of fields. Sign Gesture Recognition is one of the most sophisticated areas where computer vision and artificial intelligence have helped improve communication with physically challenged individuals in emergency circumstances, such as pain, calling for help, and so on. For deaf-populations all around the world, sign language provides a definite way of communicating while preserving their unique grammatical patterns. It emphasises the conceptually predetermined movement of the hands, arms, head, and body in order to considerably build a gesture language. Because most sign languages are not mutually intelligible, people who do not sign the same language cannot communicate with one another. American Sign Language (ASL), British Sign Language (BSL), and French Sign Language are three of the most widely used sign languages in the world. The sign language used in India is known as Indian Sign Language (ISL) [1]. According to the 2011 census, India has 2.7 million individuals who are unable to communicate and 1.8 million people who are deaf.