An Ensemble Method for Classifying Startle Eyeblink Modulation from High-Speed Video Records

Psychophysiological measurements of startle eyeblink can provide information about the state of an individual regarding sensory, attentional, cognitive, and affective processing, and thus reveal valences of interest for affective computing. However, eyeblink is usually measured using intrusive contact electromyographic (EMG) electrodes, accompanied by a laborious manual process of feature extraction. We introduce a new noninvasive automatic system using high-speed video recording of startle blinks in conjunction with data-driven feature selection and support vector machine (SVM) ensembles to classify startle eyeblinks. Using a prestimulus (prepulse) to produce robust modulation of acoustically elicited startle eyeblinks, we tracked the blinks using 250 frames per second video, and extracted different features from eyelid displacement and velocity signals. The SVMs were able to determine whether a trial had contained startle or prepulse+startle stimuli with an accuracy of up to 73 percent (five-fold cross validation). By fusing the decisions made on different feature sets, an ensemble of seven SVMs increased this rate to almost 79 percent. Since startle eyeblinks are robustly modulated by not only sensory events (such as the prepulse used in this study) but also affective and cognitive states, eyelid tracking using high-speed video, in conjunction with the introduced classification method, is an effective and user-friendly alternative to EMG for classification of startle blinks to infer users' affective-cognitive states.