Loading [MathJax]/extensions/MathMenu.js
Sparsity-Constrained fMRI Decoding of Visual Saliency in Naturalistic Video Streams | IEEE Journals & Magazine | IEEE Xplore

Sparsity-Constrained fMRI Decoding of Visual Saliency in Naturalistic Video Streams


Abstract:

Naturalistic stimuli such as video watching have been increasingly used in functional magnetic resonance imaging (fMRI)-based brain encoding and decoding studies since th...Show More

Abstract:

Naturalistic stimuli such as video watching have been increasingly used in functional magnetic resonance imaging (fMRI)-based brain encoding and decoding studies since they can provide real and dynamic information that the human brain has to process in everyday life. In this paper, we propose a sparsity-constrained decoding model to explore whether bottom-up visual saliency in continuous video streams can be effectively decoded by brain activity recorded by fMRI, and to examine whether sparsity constraints can improve visual saliency decoding. Specifically, we use a biologically-plausible computational model to quantify the visual saliency in video streams, and adopt a sparse representation algorithm to learn the atomic fMRI signal dictionaries that are representative of the patterns of whole-brain fMRI signals. Sparse representation also links the learned atomic dictionary with the quantified video saliency. Experimental results show that the temporal visual saliency in video stream can be well decoded and the sparse constraints can improve the performance of fMRI decoding models.
Published in: IEEE Transactions on Autonomous Mental Development ( Volume: 7, Issue: 2, June 2015)
Page(s): 65 - 75
Date of Publication: 09 March 2015

ISSN Information:

Funding Agency:


Contact IEEE to Subscribe

References

References is not available for this document.