WaveFusion Squeeze-and-Excitation: Towards an Accurate and Explainable Deep Learning Framework in Neuroscience

We introduce WaveFusion Squeeze-and-Excite, a multi-modal deep fusion architecture, as a practical and effective framework for classifying and localizing neurological events. WaveFusion SE is composed of lightweight CNNs for per-lead time-frequency analysis and an attention network called squeeze and excitation network with a temperature factor for effectively integrating lightweight modalities for final prediction. Our proposed architecture demonstrates high accuracy in classifying subjects’ anxiety levels with an overall accuracy of 97.53%, beating prior approaches by a considerable margin. As will also be demonstrated in the paper, our approach allows for real-time localization of neurological events during the inference without any additional post-processing. This is a great step towards an explainable DL framework for neuroscience applications.