Sign Detect: An app to detect sign language

The fast-growing world of today is advancing in every single domain. But, the deaf and dumb community–is quite far behind due to the vast communication gap in comparison to the rest of the population. To reduce this communication gap, Sign Language is being widely used and research is in progress to narrow down this gap. Even though there exist many state-of-art techniques, during the literature survey it was clear that these techniques failed to address the portability issue which reduced their acceptance by the community. Also, there doesn’t exist a full-proof comprehensive system for recognizing Alphabets, Numbers and Words. The objective of this paper is to create one such system named, SignDetect which is a Mobile Application which efficiently (1) recognizes the Sign Language; (2) quickly translates it to English and (3) then generates text and audio formats of the same. The system was tested for its accuracy with end users. Also, their User Experience (UX) was remarkable compared to the state-of-art systems used by them. As the system developed is a mobile application, it easily addressed the portability issue. And for wide acceptance, the application was developed in Flutter so that it can be easily installed on Android and iOS phones. Through this work, the authors hope to bridge the vast communication gap that is prevalent in today’s world and take a step forward in this direction.