Towards the Development of Affective Recognition Using Heart Sound Signal: A Proposal

In recent years, the development of physiological-based human emotion is centre around the use of Electroencephalogram (EEG) as the main modality. However, heart sound signal (also referred to as Phonocardiography) offersunique and reliable advantages to infer emotions. As one of thephysiological parameters, heart signals may infer emotions andcan be used for emotion recognition. In addition, the use of heartsound signals for emotion recognition is substantially cheaper,and the process of acquiring the signal for heart sound analysis iscomfortable as compared to physiological measures.Nevertheless, the use of Phonocardiography (PCG) in the emotionrecognition domain is still scarce in the research literature. Therefore, this work conducts a review on affective computing ingeneral and discusses how emotions are described and thecommon procedure used to elicit emotion. We also highlight howfar the PCG has been used in the domain of affective computing.Finally, we propose the framework and methodology to develophuman emotion recognition using heart sound signals.