A Hybrid Physiological Approach of Emotional Reaction Detection Using Combined FCM and SVM Classifier

Users' emotional reaction capturing is one of the primary issues for brain computer interface applications. Despite the intuitive feedback provided by the qualitative methods, emotional reactions are expected to be detected and classified quantitatively. Based on the human emotion representation on physiological signal, this paper offers an hybrid approach combining electroencephalogram (EEG) and facial expression together to classify the human emotion. Several advanced signal processing techniques are used to simplify the data and extract the features involving local binary patterns (LBP), Compressed Sensing (CS) and Wavelet Transform (WT). A novel machine learning algorithm, combined Fuzzy Cognitive Maps (FCM) and Support Vector Machine (SVM) are implemented to recognise the feature patterns. The result illustrates a stable emotion classification system with 75.64% accuracy. This design can provide fast and precise emotional feedback, which would further improve the communication between human and computer.