Combining Motor Imagery With Selective Sensation Toward a Hybrid-Modality BCI

A hybrid modality brain-computer interface (BCI) is proposed in this paper, which combines motor imagery with selective sensation to enhance the discrimination between left and right mental tasks, e.g., the classification between left/ right stimulation sensation and right/ left motor imagery. In this paradigm, wearable vibrotactile rings are used to stimulate both the skin on both wrists. Subjects are required to perform the mental tasks according to the randomly presented cues (i.e., left hand motor imagery, right hand motor imagery, left stimulation sensation or right stimulation sensation). Two-way ANOVA statistical analysis showed a significant group effect (F (2,20)
$=$
7.17,
$p = \hbox{0.0045}$
), and the Benferroni-corrected multiple comparison test (with
$\alpha = \hbox{0.05}$
) showed that the hybrid modality group is 11.13% higher on average than the motor imagery group, and 10.45% higher than the selective sensation group. The hybrid modality experiment exhibits potentially wider spread usage within ten subjects crossed 70% accuracy, followed by four subjects in motor imagery and five subjects in selective sensation. Six subjects showed statistically significant improvement (
$p < \hbox{0.0045}$
Benferroni-corrected) in hybrid modality in comparison with both motor imagery and selective sensation. Furthermore, among subjects having difficulties in both motor imagery and selective sensation, the hybrid modality improves their performance to 90% accuracy. The proposed hybrid modality BCI has demonstrated clear benefits for those poorly performing BCI users. Not only does the requirement of motor and sensory anticipation in this hybrid modality provide basic function of BCI for communication and control, it also has the potential for enhancing the rehabilitation during motor recovery.