Indian sign language converter system using an android app

In this paper, we introduce a sign language converter system using hand gesture recognition feature to recognize the gestures in Indian sign language and convert them to a natural language. Sign language is a large set of hand gestures that are used to communicate with the hearing impaired and mute. The proposed system uses Hue, Saturation, Intensity (HSV) color model for hand tracking and segmentation. We have used supervised learning for training the neural network which is responsible for data classification. An android application is used to capture images of hand gestures which are sent to a web hosting server, from where they are given as input to the neural network in MATLAB for pattern recognition. The hand gesture is mapped to its equivalent in natural language in MATLAB and the converted text is sent back to the users device. It is an easy-to-use and inexpensive approach to recognize single handed as well as double handed gestures accurately. This system will facilitate communication for millions of deaf and mute people and aid in communicating with people who dont understand sign language.