English to Indian Sign Language Gloss Structure Translation using Sequence to Sequence Model

A significant portion of the deaf and hard of hearing population in India uses Indian Sign Language (ISL) for communication. However, they frequently encounter significant communication and educational challenges as a result of the lack of ISL-related resources and technology. In this work, we aim to create a system for translating English text to ISL gloss structure. It can be viewed as a significant step towards ISL generation from normal text. The proposed method uses a seq2seq BiLSTM encoder-LSTM decoder based approach for performing the grammatical transformation of sentences to convert them from English to ISL gloss structure. The evaluation of the system, using BLEU score and ROUGE-L F1 score yielded good results for different batch sizes.