Sinhala Sign Language Translation through Immersive 3D Avatars and Adaptive Learning

This research paper addresses the challenge of bridging the communication gap between sign language users and non-users through a comprehensive study on sign language translation. The focus is on Sinhala Sign Language (SSL), and the research problem encompasses various innovative components. These include the conversion of Sinhala Sign Language (SSL) into text, emotion recognition and representation, personalized sign language learning, and accurate identification and translation of sign language gestures. By leveraging machine learning, deep learning, 3D modeling, and image/video processing techniques, the system enhances accessibility, communication, and education for the deaf and hard-of-hearing community. The outcomes of this research encompass an accurate and visually appealing sign language translation system, personalized learning interfaces, and the integration of emotions into sign language communication. The research contributes by providing insights into SSL grammar and lexicon, developing a tailored sign language learning curriculum, implementing reinforcement learning algorithms for personalized feedback, utilizing 3D components for enhanced visual quality, and optimizing deployments and models for improved performance. The proposed system has significant implications for improved accessibility, education, and inclusivity, fostering effective communication and understanding between sign language users and non-users.