Incorporating EEG and fNIRS Patterns to Evaluate Cortical Excitability and MI-BCI Performance During Motor Training

As electroencephalography (EEG) is nonlinear and nonstationary in nature, an imperative challenge for brain-computer interfaces (BCIs) is to construct a robust classifier that can survive for a long time and monitor the brain state stably. To this end, this research aims to improve BCI performance by incorporation of electroencephalographic and cerebral hemodynamic patterns. A motor imagery (MI)-BCI based visual-haptic neurofeedback training (NFT) experiment was designed with sixteen participants. EEG and functional near infrared spectroscopy (fNIRS) signals were simultaneously recorded before and after this transient NFT. Cortical activation was significantly improved after repeated and continuous NFT through time-frequency and topological analysis. A classifier calibration strategy, weighted EEG-fNIRS patterns (WENP), was proposed, in which elementary classifiers were constructed by using both the EEG and fNIRS information and then integrated into a strong classifier with their independent accuracy-based weight assessment. The results revealed that the classifier constructed on integrating EEG and fNIRS patterns was significantly superior to that only with independent information ( $\sim $ 10% and $\sim $ 18% improvement respectively), reaching $\sim $ 89% in mean classification accuracy. The WENP is a classifier calibration strategy that can effectively improve the performance of the MI-BCI and could also be used to other BCI paradigms. These findings validate that our proposed methods are feasible and promising for optimizing conventional motor training methods and clinical rehabilitation.