Music Recommendation based on Facial Expressions using Data Augmentation

Emotion recognition from facial expressions plays a pivotal role in human-computer interaction, psychology, marketing, and various other domains. This research paper presents a comprehensive study and implementation of an automated emotion recognition system based on deep learning techniques. The project addresses the challenge of accurately classifying a wide range of emotions from facial images in real-time. Leveraging Convolutional Neural Networks (CNNs) and modern deep learning approaches, the system demonstrates high accuracy in identifying emotions, including happiness, sadness, anger, and more. This project used the image dataset FER-2013 for the mood prediction portion of the project, and Spotify music data to predict emotions for music recommendation. Both the datasets utilized are freely available on Kaggle. The proposed system can achieve an accuracy of 91.23% in predicting the users’ emotion based on their facial expressions.