Towards Developing a Transformer-Based Bangla Typing Error Correction Model: A Deep Learning-Based Approach

Despite being the sixth most widely spoken language globally, the Bangla language faces a lack of effective and efficient automated methods to correct keyboard errors in written text. Such errors can result in communication misunderstandings and misinterpretations, particularly in the digital domain, where written text plays a crucial role in communication and is heavily relied upon. However, no keyboard error model for the Bangla language has been found due to the lack of available datasets. In this research work, we have proposed a probabilistic approach to generate a synthetic Bangla keyboard typing error correction (BKTEC) dataset. By utilizing the novel BKTEC dataset, we have fine-tuned a transformer-based model for Keyboard error correction. After training it to convergence, the proposed model has been tested on a test dataset, and we have found a word level accuracy of 88.56%.