By Topic

Bimodal approach in emotion recognition using speech and facial expressions

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

3 Author(s)
Emerich, S. ; Commun. Dept., Tech. Univ. of Cluj-Napoca, Cluj-Napoca, Romania ; Lupu, E. ; Apatean, A.

This paper aims to present a multimodal approach in emotion recognition which integrates information from both facial expressions and speech signal. Using two acted databases on different subjects, we were able to emphasize six emotions: sadness, anger, happiness, disgust, fear and neutral state. The models in the system were designed and tested by using a Support Vector Machine classifier. Firstly, the analysis of the strengths and the limitations of the systems based only on facial expressions or speech signal was performed. Data was then fused at the feature level. The results show that in this case the performance and the robustness of the emotion recognition system have been improved.

Published in:

Signals, Circuits and Systems, 2009. ISSCS 2009. International Symposium on

Date of Conference:

9-10 July 2009