Kronecker-Basis-Representation Based Tensor Sparsity and Its Applications to Tensor Recovery | IEEE Journals & Magazine | IEEE Xplore

Kronecker-Basis-Representation Based Tensor Sparsity and Its Applications to Tensor Recovery


Abstract:

As a promising way for analyzing data, sparse modeling has achieved great success throughout science and engineering. It is well known that the sparsity/low-rank of a vec...Show More

Abstract:

As a promising way for analyzing data, sparse modeling has achieved great success throughout science and engineering. It is well known that the sparsity/low-rank of a vector/matrix can be rationally measured by nonzero-entries-number (l0 norm)/nonzerosingular-values-number (rank), respectively. However, data from real applications are often generated by the interaction of multiple factors, which obviously cannot be sufficiently represented by a vector/matrix, while a high order tensor is expected to provide more faithful representation to deliver the intrinsic structure underlying such data ensembles. Unlike the vector/matrix case, constructing a rational high order sparsity measure for tensor is a relatively harder task. To this aim, in this paper we propose a measure for tensor sparsity, called Kronecker-basis-representation based tensor sparsity measure (KBR briefly), which encodes both sparsity insights delivered by Tucker and CANDECOMP/PARAFAC (CP) low-rank decompositions for a general tensor. Then we study the KBR regularization minimization (KBRM) problem, and design an effective ADMM algorithm for solving it, where each involved parameter can be updated with closed-form equations. Such an efficient solver makes it possible to extend KBR to various tasks like tensor completion and tensor robust principal component analysis. A series of experiments, including multispectral image (MSI) denoising, MSI completion and background subtraction, substantiate the superiority of the proposed methods beyond state-of-the-arts.
Published in: IEEE Transactions on Pattern Analysis and Machine Intelligence ( Volume: 40, Issue: 8, 01 August 2018)
Page(s): 1888 - 1902
Date of Publication: 02 August 2017

ISSN Information:

PubMed ID: 28783623

Funding Agency:

Author image of Qi Xie
School of Mathematics and Statistics and Ministry of Education Key Lab of Intelligent Networks and Network Security, Xi’an Jiaotong University, Shaanxi, P.R. China
Qi Xie received the BSc degree from Xi’an Jiaotong University, Xi’an, China, in 2013, where he is currently working toward the PhD degree. His current research interests include low-rank matrix factorization, tensor recovery, and sparse machine learning methods.
Qi Xie received the BSc degree from Xi’an Jiaotong University, Xi’an, China, in 2013, where he is currently working toward the PhD degree. His current research interests include low-rank matrix factorization, tensor recovery, and sparse machine learning methods.View more
Author image of Qian Zhao
School of Mathematics and Statistics and Ministry of Education Key Lab of Intelligent Networks and Network Security, Xi’an Jiaotong University, Shaanxi, P.R. China
Qian Zhao received the BSc and PhD degrees from Xi’an Jiaotong University, Xi’an, China, in 2009 and 2015, respectively. He was a visiting scholar with Carnegie Mellon University, Pittsburgh, Pennsylvania, from 2013 to 2014. He is currently a lecturer in the School of Mathematics and Statistics, Xi’an Jiaotong University. His current research interests include low-rank matrix/tensor analysis, Bayesian modeling and sel...Show More
Qian Zhao received the BSc and PhD degrees from Xi’an Jiaotong University, Xi’an, China, in 2009 and 2015, respectively. He was a visiting scholar with Carnegie Mellon University, Pittsburgh, Pennsylvania, from 2013 to 2014. He is currently a lecturer in the School of Mathematics and Statistics, Xi’an Jiaotong University. His current research interests include low-rank matrix/tensor analysis, Bayesian modeling and sel...View more
Author image of Deyu Meng
School of Mathematics and Statistics and Ministry of Education Key Lab of Intelligent Networks and Network Security, Xi’an Jiaotong University, Shaanxi, P.R. China
Deyu Meng received the BSc, MSc, and PhD degrees from Xi’an Jiaotong University, Xi’an, China, in 2001, 2004, and 2008, respectively. He was a visiting scholar with Carnegie Mellon University, Pittsburgh, Pennsylvania, from 2012 to 2014. He is currently a professor in the Institute for Information and System Sciences, Xi’an Jiaotong University. His current research interests include self-paced learning, noise modeling...Show More
Deyu Meng received the BSc, MSc, and PhD degrees from Xi’an Jiaotong University, Xi’an, China, in 2001, 2004, and 2008, respectively. He was a visiting scholar with Carnegie Mellon University, Pittsburgh, Pennsylvania, from 2012 to 2014. He is currently a professor in the Institute for Information and System Sciences, Xi’an Jiaotong University. His current research interests include self-paced learning, noise modeling...View more
Author image of Zongben Xu
School of Mathematics and Statistics and Ministry of Education Key Lab of Intelligent Networks and Network Security, Xi’an Jiaotong University, Shaanxi, P.R. China
Zongben Xu received the PhD degree in mathematics from Xi’an Jiaotong University, Xi’an, China, in 1987. He currently serves as the Academician of the Chinese Academy of Sciences, the chief scientist of the National Basic Research Program of China (973 Project), and the director of the Institute for Information and System Sciences, Xi’an Jiaotong University. His current research interests include nonlinear functional ...Show More
Zongben Xu received the PhD degree in mathematics from Xi’an Jiaotong University, Xi’an, China, in 1987. He currently serves as the Academician of the Chinese Academy of Sciences, the chief scientist of the National Basic Research Program of China (973 Project), and the director of the Institute for Information and System Sciences, Xi’an Jiaotong University. His current research interests include nonlinear functional ...View more

Author image of Qi Xie
School of Mathematics and Statistics and Ministry of Education Key Lab of Intelligent Networks and Network Security, Xi’an Jiaotong University, Shaanxi, P.R. China
Qi Xie received the BSc degree from Xi’an Jiaotong University, Xi’an, China, in 2013, where he is currently working toward the PhD degree. His current research interests include low-rank matrix factorization, tensor recovery, and sparse machine learning methods.
Qi Xie received the BSc degree from Xi’an Jiaotong University, Xi’an, China, in 2013, where he is currently working toward the PhD degree. His current research interests include low-rank matrix factorization, tensor recovery, and sparse machine learning methods.View more
Author image of Qian Zhao
School of Mathematics and Statistics and Ministry of Education Key Lab of Intelligent Networks and Network Security, Xi’an Jiaotong University, Shaanxi, P.R. China
Qian Zhao received the BSc and PhD degrees from Xi’an Jiaotong University, Xi’an, China, in 2009 and 2015, respectively. He was a visiting scholar with Carnegie Mellon University, Pittsburgh, Pennsylvania, from 2013 to 2014. He is currently a lecturer in the School of Mathematics and Statistics, Xi’an Jiaotong University. His current research interests include low-rank matrix/tensor analysis, Bayesian modeling and self-paced learning.
Qian Zhao received the BSc and PhD degrees from Xi’an Jiaotong University, Xi’an, China, in 2009 and 2015, respectively. He was a visiting scholar with Carnegie Mellon University, Pittsburgh, Pennsylvania, from 2013 to 2014. He is currently a lecturer in the School of Mathematics and Statistics, Xi’an Jiaotong University. His current research interests include low-rank matrix/tensor analysis, Bayesian modeling and self-paced learning.View more
Author image of Deyu Meng
School of Mathematics and Statistics and Ministry of Education Key Lab of Intelligent Networks and Network Security, Xi’an Jiaotong University, Shaanxi, P.R. China
Deyu Meng received the BSc, MSc, and PhD degrees from Xi’an Jiaotong University, Xi’an, China, in 2001, 2004, and 2008, respectively. He was a visiting scholar with Carnegie Mellon University, Pittsburgh, Pennsylvania, from 2012 to 2014. He is currently a professor in the Institute for Information and System Sciences, Xi’an Jiaotong University. His current research interests include self-paced learning, noise modeling, and tensor sparsity.
Deyu Meng received the BSc, MSc, and PhD degrees from Xi’an Jiaotong University, Xi’an, China, in 2001, 2004, and 2008, respectively. He was a visiting scholar with Carnegie Mellon University, Pittsburgh, Pennsylvania, from 2012 to 2014. He is currently a professor in the Institute for Information and System Sciences, Xi’an Jiaotong University. His current research interests include self-paced learning, noise modeling, and tensor sparsity.View more
Author image of Zongben Xu
School of Mathematics and Statistics and Ministry of Education Key Lab of Intelligent Networks and Network Security, Xi’an Jiaotong University, Shaanxi, P.R. China
Zongben Xu received the PhD degree in mathematics from Xi’an Jiaotong University, Xi’an, China, in 1987. He currently serves as the Academician of the Chinese Academy of Sciences, the chief scientist of the National Basic Research Program of China (973 Project), and the director of the Institute for Information and System Sciences, Xi’an Jiaotong University. His current research interests include nonlinear functional analysis and intelligent information processing. He was a recipient of the National Natural Science Award of China in 2007 and the winner of the CSIAM Su Buchin Applied Mathematics Prize in 2008. He delivered a talk at the International Congress of Mathematicians in 2010.
Zongben Xu received the PhD degree in mathematics from Xi’an Jiaotong University, Xi’an, China, in 1987. He currently serves as the Academician of the Chinese Academy of Sciences, the chief scientist of the National Basic Research Program of China (973 Project), and the director of the Institute for Information and System Sciences, Xi’an Jiaotong University. His current research interests include nonlinear functional analysis and intelligent information processing. He was a recipient of the National Natural Science Award of China in 2007 and the winner of the CSIAM Su Buchin Applied Mathematics Prize in 2008. He delivered a talk at the International Congress of Mathematicians in 2010.View more

Contact IEEE to Subscribe

References

References is not available for this document.