Smart Assistant for Deaf and Dumb Using Flexible Resistive Sensor : Implemented on LabVIEW Platform

The people with hearing and speaking difficulties use sign language to converse with each other. They have difficulties while conversing with people who do not know sign language. We have addressed this issue in our proposed project. This project proposes a model of Smart gloves and flex sensors for Sign language recognition. The proposed approach is based on detection of the finger movements and hand gestures to identify the gesture using signal processing kit in LabVIEW software and a data acquisition device (NI USB 6008 DAQ card). The signal is processed and is used to identify the sign shown and concatenate the letters into suitable word and also present the word in audio format. In our work we aim to provide a solution for the trainers in deaf and dumb schools to display letters, with its associated visual display, along with audio output, making learning very interactive and encouraging. It can be used to help treat patients suffering from speech-loss and partial paralysis patient with minimal movement of their fingers. In this project we have implemented the code in LabVIEW platform for twenty-six letters and concatenation of letters up to 6 letters according to American Sign Language. Algorithm can be customized to build the required word length.