Empowering Deaf Children with Sinhala Sign Language, Emotion Detection, and Sound Recognition

This study describes a broad endeavor to use cutting-edge technologies to empower deaf primary school students in Sri Lanka. Three key elements make up the study: a sound recognition and classification system, an Android software for translating gestures in Sinhala Sign Language (SSL), and a mobile app for emotion recognition and text-tospeech in Sinhala. By promptly alerting caregivers to potential dangers, the sound recognition technology secures the security of deaf children at home, providing an invaluable layer of security. The Android software bridges the communication gap and improves family interactions by translating SSL gestures captured by the device's camera into textual representations. This promotes successful communication between deaf children and their parents. Convolutional Neural Networks (CNNs) are used in the mobile application to detect and understand emotions based on facial expressions. This enables non-verbal youngsters to communicate successfully through Sinhala textto-speech output with adaptive tone modulation. This research aims to build a caring and inclusive atmosphere, enabling increased independence and enhanced communication skills in deaf children by combining these advances. The suggested solutions could significantly improve the lives of deaf kids, providing them with opportunities for better learning, social interaction, and emotional health.