Audio to Sign Language Translation using NLP

Communication is an essential aspect of human life, but deaf people often face challenges in communicating with hearing people due to the language barrier. According to the World Health Organization, 466 million individuals, or 5% of the global population, have severe auditory loss. In India, there are roughly 18 million people who are deaf. Sign language is the primary way of communicating information for the deaf, but it requires significant time and effort to learn. To bridge this gap, we propose an Audio to Sign Language Translation solution that converts live voice or audio recordings through text forms and shows pertinent Animated GIFs or Sign Language images. The application uses frontend Easy Gui, PyAudio for microphone input, Google Speech API, and Sphinx for speech recognition, NLP for text preprocessing, and a dictionary-based machine translation approach for sign language generation. The algorithm follows a logical sequence of steps and provides an accurate and reliable solution to facilitate communication between deaf and hearing people. The purpose of this application is to give deaf individuals access to information and services in Indian sign language and to create a scalable project that can record the whole ISL vocabulary using both manual and non-manual signs. Overall, by enabling deaf people to communicate, the Audio to Sign Language Translation has the ability to significantly improve their quality of life to communicate easily and effectively with others.