Comparison of Transformer Based and Traditional Models on Sentiment Analysis on Social Media Datasets

In the field of computers and natural language processing, there is an interesting sub-field, namely sentiment analysis. Currently, the use of social media Twitter to actively communicate between individuals contains various review data, opinion data, and emotional data from discussions of topics between users on social media. So that the data generated by Twitter social media can identify patterns in the data for the field of sentiment analysis. In the sentiment analysis sub-sector, there are approaches, namely transformer-based models and traditional models, the traditional model includes the naïve Bayes algorithm, support vector machine, and regression have weaknesses in overcoming data complexity in Indonesian language tweets on Twitter social media while the transformer model includes the BERT (Bidirectional Encoder Representations from Transformers) algorithm is often applied because it has advantages in overcoming the complexity of Indonesian sentences in tweets obtained from social media and in the process this model goes through a training stage with large amounts of data then is adjusted in the concept of sentiment analysis.