Digital Twin Model: A Real-Time Emotion Recognition System for Personalized Healthcare

Emotion recognition (ER) in healthcare has drawn substantial attention owing to recent advancements in machine-learning (ML) and deep-learning (DL) techniques. The ER system, along with a digital twin of a person in real time, will facilitate the monitoring, understanding, and improvement of the physical entity’s capabilities, as well as provide constant input to improve quality of life and well-being for personalized healthcare. However, building such ER systems in real time involves technical challenges, such as limited datasets, occlusion and lighting issues, identifying important features, false classification of emotions, and high implementation costs. To resolve this issue, we built a simple, efficient, and adaptable ER system by acquiring and processing images in real time using a web camera. In addition, we propose an end-to-end framework that combines an ER system with a digital twin setup, in which the predicted result can be analyzed and tested prior to providing the best possible personal healthcare treatment before it leads to any life-threatening disease. Our proposed ER system achieved promising results in less training time without compromising the accuracy. Thus, in real time, it will be helpful in healthcare centers to monitor a patient’s health condition, early diagnosis of life-threatening diseases, and to obtain the best and most effective treatment for patients during emergencies.