Loading [MathJax]/extensions/MathMenu.js
Tensor Cascaded-Rank Minimization in Subspace: A Unified Regime for Hyperspectral Image Low-Level Vision | IEEE Journals & Magazine | IEEE Xplore

Tensor Cascaded-Rank Minimization in Subspace: A Unified Regime for Hyperspectral Image Low-Level Vision


Abstract:

Low-rank tensor representation philosophy has enjoyed a reputation in many hyperspectral image (HSI) low-level vision applications, but previous studies often failed to c...Show More

Abstract:

Low-rank tensor representation philosophy has enjoyed a reputation in many hyperspectral image (HSI) low-level vision applications, but previous studies often failed to comprehensively exploit the low-rank nature of HSI along different modes in low-dimensional subspace, and unsurprisingly handled only one specific task. To address these challenges, in this paper, we figured out that in addition to the spatial correlation, the spectral dependency of HSI also implicitly exists in the coefficient tensor of its subspace, this crucial dependency that was not fully utilized by previous studies yet can be effectively exploited in a cascaded manner. This led us to propose a unified subspace low-rank learning regime with a new tensor cascaded rank minimization, named STCR, to fully couple the low-rankness of HSI in different domains for various low-level vision tasks. Technically, the high-dimensional HSI was first projected into a low-dimensional tensor subspace, then a novel tensor low-cascaded-rank decomposition was designed to collapse the constructed tensor into three core tensors in succession to more thoroughly exploit the correlations in spatial, nonlocal, and spectral modes of the coefficient tensor. Next, difference continuity-regularization was introduced to learn a basis that more closely approximates the HSI’s endmembers. The proposed regime realizes a comprehensive delineation of the self-portrait of HSI tensor. Extensive evaluations conducted with dozens of state-of-the-art (SOTA) baselines on eight datasets verified that the proposed regime is highly effective and robust to typical HSI low-level vision tasks, including denoising, compressive sensing reconstruction, inpainting, and destriping. The source code of our method is released at https://github.com/CX-He/STCR.git.
Published in: IEEE Transactions on Image Processing ( Volume: 32)
Page(s): 100 - 115
Date of Publication: 07 December 2022

ISSN Information:

PubMed ID: 37015482

Funding Agency:

Author image of Le Sun
School of Computer Science, Jiangsu Collaborative Innovation Center of Atmospheric Environment and Equipment Technology (CICAEET), and Engineering Research Center of Digital Forensics, Ministry of Education, Nanjing University of Information Science and Technology (NUIST), Nanjing, China
Le Sun (Member, IEEE) was born in Jiangsu, China, in 1987. He received the B.S. degree from the School of Science, Nanjing University of Science and Technology (NJUST), Nanjing, Jiangsu, in 2009, and the Ph.D. degree from the School of Computer Science and Engineering, NJUST, in 2014.
From 2015 to 2018, he has conducted a Research in the field of multi-images fusion based on sparse dictionary learning and compressive sensi...Show More
Le Sun (Member, IEEE) was born in Jiangsu, China, in 1987. He received the B.S. degree from the School of Science, Nanjing University of Science and Technology (NJUST), Nanjing, Jiangsu, in 2009, and the Ph.D. degree from the School of Computer Science and Engineering, NJUST, in 2014.
From 2015 to 2018, he has conducted a Research in the field of multi-images fusion based on sparse dictionary learning and compressive sensi...View more
Author image of Chengxun He
School of Computer Science and Engineering, Nanjing University of Science and Technology (NJUST), Nanjing, China
Chengxun He received the B.S. and M.S. degrees in computer science and technology from the Nanjing University of Information Science and Technology. He is currently pursuing the Ph.D. degree with the Nanjing University of Science and Technology (NJUST), Nanjing, Jiangsu, China. His research interest is hyperspectral image processing.
Chengxun He received the B.S. and M.S. degrees in computer science and technology from the Nanjing University of Information Science and Technology. He is currently pursuing the Ph.D. degree with the Nanjing University of Science and Technology (NJUST), Nanjing, Jiangsu, China. His research interest is hyperspectral image processing.View more
Author image of Yuhui Zheng
School of Computer Science, Jiangsu Collaborative Innovation Center of Atmospheric Environment and Equipment Technology (CICAEET), and Engineering Research Center of Digital Forensics, Ministry of Education, Nanjing University of Information Science and Technology (NUIST), Nanjing, China
Yuhui Zheng (Member, IEEE) was born in Shanxi, China, in 1982. He received the B.S. degree in chemistry and the Ph.D. degree in computer science from the Nanjing University of Science and Technology (NJUST), Nanjing, Jiangsu, China, in 2004 and 2009, respectively.
From 2014 to 2015, he was a Visiting Scholar at the Digital Media Laboratory, School of Electronic and Electrical Engineering, Sungkyunkwan University, South Kor...Show More
Yuhui Zheng (Member, IEEE) was born in Shanxi, China, in 1982. He received the B.S. degree in chemistry and the Ph.D. degree in computer science from the Nanjing University of Science and Technology (NJUST), Nanjing, Jiangsu, China, in 2004 and 2009, respectively.
From 2014 to 2015, he was a Visiting Scholar at the Digital Media Laboratory, School of Electronic and Electrical Engineering, Sungkyunkwan University, South Kor...View more
Author image of Zebin Wu
School of Computer Science and Engineering, Nanjing University of Science and Technology (NJUST), Nanjing, China
Zebin Wu (Senior Member, IEEE) was born in Zhejiang, China, in 1981. He received the B.S. and Ph.D. degrees from the School of Computer Science and Engineering, Nanjing University of Science and Technology (NJUST), Nanjing, Jiangsu, China, in 2003 and 2008, respectively.
He is currently working at the School of Computer Science and Engineering, NJUST, as a Full Professor. His research interests include virtual reality, sys...Show More
Zebin Wu (Senior Member, IEEE) was born in Zhejiang, China, in 1981. He received the B.S. and Ph.D. degrees from the School of Computer Science and Engineering, Nanjing University of Science and Technology (NJUST), Nanjing, Jiangsu, China, in 2003 and 2008, respectively.
He is currently working at the School of Computer Science and Engineering, NJUST, as a Full Professor. His research interests include virtual reality, sys...View more
Author image of Byeungwoo Jeon
School of Electronic and Electrical Engineering, Sungkyunkwan University, Suwon, South Korea
Byeungwoo Jeon (Senior Member, IEEE) received the B.S. (magna cum laude) and M.S. degrees in electronics engineering from Seoul National University, Seoul, South Korea, in 1985 and 1987, respectively, and the Ph.D. degree in electrical engineering from Purdue University, West Lafayette, in 1992. From 1993 to 1997, he was at the Signal Processing Laboratory, Samsung Electronics, South Korea, where he has conducted research...Show More
Byeungwoo Jeon (Senior Member, IEEE) received the B.S. (magna cum laude) and M.S. degrees in electronics engineering from Seoul National University, Seoul, South Korea, in 1985 and 1987, respectively, and the Ph.D. degree in electrical engineering from Purdue University, West Lafayette, in 1992. From 1993 to 1997, he was at the Signal Processing Laboratory, Samsung Electronics, South Korea, where he has conducted research...View more

Author image of Le Sun
School of Computer Science, Jiangsu Collaborative Innovation Center of Atmospheric Environment and Equipment Technology (CICAEET), and Engineering Research Center of Digital Forensics, Ministry of Education, Nanjing University of Information Science and Technology (NUIST), Nanjing, China
Le Sun (Member, IEEE) was born in Jiangsu, China, in 1987. He received the B.S. degree from the School of Science, Nanjing University of Science and Technology (NJUST), Nanjing, Jiangsu, in 2009, and the Ph.D. degree from the School of Computer Science and Engineering, NJUST, in 2014.
From 2015 to 2018, he has conducted a Research in the field of multi-images fusion based on sparse dictionary learning and compressive sensing, as a Postdoctor at the School of Electronic and Electrical Engineering, Sungkyunkwan University, South Korea. Since 2020, he has been an Associate Professor with the School of Computer Science, Nanjing University of Information Science and Technology, Nanjing. His research interests include hyperspectral image processing (including unmixing, classification, and restoration), sparse representation, compressive sensing, and deep learning.
Le Sun (Member, IEEE) was born in Jiangsu, China, in 1987. He received the B.S. degree from the School of Science, Nanjing University of Science and Technology (NJUST), Nanjing, Jiangsu, in 2009, and the Ph.D. degree from the School of Computer Science and Engineering, NJUST, in 2014.
From 2015 to 2018, he has conducted a Research in the field of multi-images fusion based on sparse dictionary learning and compressive sensing, as a Postdoctor at the School of Electronic and Electrical Engineering, Sungkyunkwan University, South Korea. Since 2020, he has been an Associate Professor with the School of Computer Science, Nanjing University of Information Science and Technology, Nanjing. His research interests include hyperspectral image processing (including unmixing, classification, and restoration), sparse representation, compressive sensing, and deep learning.View more
Author image of Chengxun He
School of Computer Science and Engineering, Nanjing University of Science and Technology (NJUST), Nanjing, China
Chengxun He received the B.S. and M.S. degrees in computer science and technology from the Nanjing University of Information Science and Technology. He is currently pursuing the Ph.D. degree with the Nanjing University of Science and Technology (NJUST), Nanjing, Jiangsu, China. His research interest is hyperspectral image processing.
Chengxun He received the B.S. and M.S. degrees in computer science and technology from the Nanjing University of Information Science and Technology. He is currently pursuing the Ph.D. degree with the Nanjing University of Science and Technology (NJUST), Nanjing, Jiangsu, China. His research interest is hyperspectral image processing.View more
Author image of Yuhui Zheng
School of Computer Science, Jiangsu Collaborative Innovation Center of Atmospheric Environment and Equipment Technology (CICAEET), and Engineering Research Center of Digital Forensics, Ministry of Education, Nanjing University of Information Science and Technology (NUIST), Nanjing, China
Yuhui Zheng (Member, IEEE) was born in Shanxi, China, in 1982. He received the B.S. degree in chemistry and the Ph.D. degree in computer science from the Nanjing University of Science and Technology (NJUST), Nanjing, Jiangsu, China, in 2004 and 2009, respectively.
From 2014 to 2015, he was a Visiting Scholar at the Digital Media Laboratory, School of Electronic and Electrical Engineering, Sungkyunkwan University, South Korea. He is currently a Full Professor at the School of Computer and Science, Nanjing University of Information Science and Technology. His research interests cover image processing, pattern recognition, and remote sensing information systems.
Yuhui Zheng (Member, IEEE) was born in Shanxi, China, in 1982. He received the B.S. degree in chemistry and the Ph.D. degree in computer science from the Nanjing University of Science and Technology (NJUST), Nanjing, Jiangsu, China, in 2004 and 2009, respectively.
From 2014 to 2015, he was a Visiting Scholar at the Digital Media Laboratory, School of Electronic and Electrical Engineering, Sungkyunkwan University, South Korea. He is currently a Full Professor at the School of Computer and Science, Nanjing University of Information Science and Technology. His research interests cover image processing, pattern recognition, and remote sensing information systems.View more
Author image of Zebin Wu
School of Computer Science and Engineering, Nanjing University of Science and Technology (NJUST), Nanjing, China
Zebin Wu (Senior Member, IEEE) was born in Zhejiang, China, in 1981. He received the B.S. and Ph.D. degrees from the School of Computer Science and Engineering, Nanjing University of Science and Technology (NJUST), Nanjing, Jiangsu, China, in 2003 and 2008, respectively.
He is currently working at the School of Computer Science and Engineering, NJUST, as a Full Professor. His research interests include virtual reality, system simulation, remote sensing information processing, and distributed computing.
Zebin Wu (Senior Member, IEEE) was born in Zhejiang, China, in 1981. He received the B.S. and Ph.D. degrees from the School of Computer Science and Engineering, Nanjing University of Science and Technology (NJUST), Nanjing, Jiangsu, China, in 2003 and 2008, respectively.
He is currently working at the School of Computer Science and Engineering, NJUST, as a Full Professor. His research interests include virtual reality, system simulation, remote sensing information processing, and distributed computing.View more
Author image of Byeungwoo Jeon
School of Electronic and Electrical Engineering, Sungkyunkwan University, Suwon, South Korea
Byeungwoo Jeon (Senior Member, IEEE) received the B.S. (magna cum laude) and M.S. degrees in electronics engineering from Seoul National University, Seoul, South Korea, in 1985 and 1987, respectively, and the Ph.D. degree in electrical engineering from Purdue University, West Lafayette, in 1992. From 1993 to 1997, he was at the Signal Processing Laboratory, Samsung Electronics, South Korea, where he has conducted research and development into video compression algorithms, the design of digital broadcasting satellite receivers, and other MPEG-related research for multimedia applications. Since September 1997, he has been with the Faculty of the School of Electronic and Electrical Engineering, Sungkyunkwan University, South Korea, where he is currently a Full Professor. He served as the Project Manager of Digital TV and Broadcasting at the Korean Ministry of Information and Communications, from March 2004 to February 2006, where he supervised all digital TV-related research and development in South Korea. He has authored many papers in the areas of video compression, pre/post processing, and pattern recognition. His research interests include multimedia signal processing, video compression, statistical pattern recognition, and remote sensing. He is a member of Tau Beta Pi and Eta Kappa Nu. He is also a member of SPIE, IEEK, KICS, and KSOBE. He was a recipient of the 2005 IEEK Haedong Paper Award in Signal Processing Society, South Korea.
Byeungwoo Jeon (Senior Member, IEEE) received the B.S. (magna cum laude) and M.S. degrees in electronics engineering from Seoul National University, Seoul, South Korea, in 1985 and 1987, respectively, and the Ph.D. degree in electrical engineering from Purdue University, West Lafayette, in 1992. From 1993 to 1997, he was at the Signal Processing Laboratory, Samsung Electronics, South Korea, where he has conducted research and development into video compression algorithms, the design of digital broadcasting satellite receivers, and other MPEG-related research for multimedia applications. Since September 1997, he has been with the Faculty of the School of Electronic and Electrical Engineering, Sungkyunkwan University, South Korea, where he is currently a Full Professor. He served as the Project Manager of Digital TV and Broadcasting at the Korean Ministry of Information and Communications, from March 2004 to February 2006, where he supervised all digital TV-related research and development in South Korea. He has authored many papers in the areas of video compression, pre/post processing, and pattern recognition. His research interests include multimedia signal processing, video compression, statistical pattern recognition, and remote sensing. He is a member of Tau Beta Pi and Eta Kappa Nu. He is also a member of SPIE, IEEK, KICS, and KSOBE. He was a recipient of the 2005 IEEK Haedong Paper Award in Signal Processing Society, South Korea.View more
Contact IEEE to Subscribe

References

References is not available for this document.