By Topic

Fusion of fMRI, sMRI, and EEG data using canonical correlation analysis

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$33 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

4 Author(s)
Nicolle M. Correa ; University of Maryland, Baltimore County, Department of CSEE, 21250, USA ; Yi-Ou Li ; Tulay Adali ; Vince D. Calhoun

Typically data acquired through imaging techniques such as functional magnetic resonance imaging (fMRI), structural MRI (sMRI), and electroencephalography(EEG) are analyzed separately. Each modality records brain structure and function at different scales, and fusing information from such complementary modalities promises to provide additional insight into connectivity across brain networks and changes due to disease. Recently, a number of methods have been proposed for data integration and fusion of two brain imaging modalities. We propose a new data fusion scheme based on canonical correlation analysis that enables the detection of associations across multiple modalities. Our multimodal canonical correlation analysis (mCCA) scheme works at the feature level using multi-set CCA to determine inter-subject covariations across modalities. We apply mCCA to fMRI, sMRI, and EEG data collected from patients diagnosed with schizophrenia and healthy controls. Through data collected from an auditory oddball task, we show that the fusion of multiple modalities detects more specific associations as compared to fusion of two modalities.

Published in:

2009 IEEE International Conference on Acoustics, Speech and Signal Processing

Date of Conference:

19-24 April 2009