Linguistic Harmony in Diversity: Lemmatizing Rojak Malay for Global Communication

This paper presents a comprehensive approach to lemmatization and standardization of the Rojak Malay language. Rojak Malay, characterized by its amalgamation of Malay and English words, poses unique challenges for natural language processing (NLP). Our methodology leverages the combination of various techniques in a predefined order, including English lemmatization using WordNet, translation with GoogleTranslator, stemming using Sastrawi stemmer, normalization using BM_dict.csv dataset and Bahasa Malaysia lemmatization using Malaya to transform Rojak Malay into Standard Malay effectively. The system achieved an accuracy rate of 100% in lemmatizing a random sample of individual words. However, certain limitations were identified, such as challenges in handling code-mixed sentences and English out-of-vocabulary (OOV) words. This paper also discusses the implications and prospects of extending this approach to accommodate a wider range of languages found in the Rojak Malay context.