Remote Estimation of Video-Based Vital Signs in Emotion Invocation Studies

The goal of this study is to examine the influence of various imitated and video invoked emotions on the vital signs (respiratory and pulse rates). We also perform an analysis of the possibility to extract signals from sequences acquired with cost-effective cameras. The preliminary results show that the respiratory rate allows for better separation of some emotions than the pulse rate, yet this relation highly depends on a subject. The invoked positive emotion resulted in a respiratory rate difference >1.8 bpm, comparing to the average respiration rate of all neutral results (in 89% of observations). Visual facial expression in many cases was insufficient for emotion recognition (in video based experiment only 11.4% of visual responses were classified as an expected emotion).