Improving English to Persian Machine Translation with GPT Language Model and Autoencoders

Machine translation is a technology that reduces costs and speeds up the translation for users by mechanizing translation from one language to another. Machine translation is essentially a step towards globalization for every culture, science, industry, and system. This technology has made great strides in cognitive understanding of natural language since 2013 with the advent of deep learning models. But deep models also always need a lot of data for training. Therefore, the lack of a lot of data and parallel corpus in machine translation is one of the most important problems in this area. Machine translation from English to Persian always suffers from the problem of a lack of resources and data. This article tries to study the deep learning models in machine translation from English to Persian and their strengths and weaknesses, In this article, to solve the problem of lack of English- to-Persian data, the Transformer-based model has been integrated and improved with the Persian language model that has GPT architecture, in addition, the CNN model has been integrated and improved with Autoencoder to improve feature selection and reduce dimensions.