Remote Sensing Image Super-Resolution via Residual Aggregation and Split Attentional Fusion Network | IEEE Journals & Magazine | IEEE Xplore
Scheduled Maintenance: On Tuesday, 8 April, IEEE Xplore will undergo scheduled maintenance from 1:00-5:00 PM ET (1800-2200 UTC). During this time, there may be intermittent impact on performance. We apologize for any inconvenience.

Remote Sensing Image Super-Resolution via Residual Aggregation and Split Attentional Fusion Network


Abstract:

Remote sensing images contain various land surface scenes and different scales of ground objects, which greatly increases the difficulty of super-resolution tasks. The ex...Show More

Abstract:

Remote sensing images contain various land surface scenes and different scales of ground objects, which greatly increases the difficulty of super-resolution tasks. The existing deep learning-based methods cannot solve this problem well. To achieve high-quality super-resolution of remote sensing images, a residual aggregation and split attentional fusion network (RASAF) is proposed in this article. It is mainly divided into the following three parts. First, a split attentional fusion block is proposed. It uses a basic split–fusion mechanism to achieve cross-channel feature group interaction, allowing the method to adapt to various land surface scene reconstructions. Second, to fully exploit multiscale image information, a hierarchical loss function is used. Third, residual learning is used to reduce the difficulty of training in super-resolution tasks. However, the respective residual branch features are used quite locally and fail to represent the real value. A residual aggregation mechanism is used to aggregate the local residual branch features to generate higher quality local residual branch features. The comparison of RASAF with some classical super-resolution methods using two widely used remote sensing datasets showed that the RASAF achieved better performance. And it achieves a good balance between performance and model parameter number. Meanwhile, the RASAF’s ability to support multilabel remote sensing image classification tasks demonstrates its usefulness.
Page(s): 9546 - 9556
Date of Publication: 20 September 2021

ISSN Information:

Funding Agency:

Author image of Long Chen
College of Software, Xinjiang University, Ürümqi, China
Key Laboratory of Signal Detection and Processing in Xinjiang Uygur Autonomous Region, Ürümqi, China
Key Laboratory of Software Engineering, Ürümqi, China
Long Chen received the bachelor’s degree in geographic information science from the Shandong University of Science and Technology, Qingdao, China, in 2018. He is currently working toward the master’s degree in software engineering with Xinjiang University, Ürümqi, China.
His research interests include deep learning and single image super-resolution.
Long Chen received the bachelor’s degree in geographic information science from the Shandong University of Science and Technology, Qingdao, China, in 2018. He is currently working toward the master’s degree in software engineering with Xinjiang University, Ürümqi, China.
His research interests include deep learning and single image super-resolution.View more
Author image of Hui Liu
College of Information Science and Engineering, Xinjiang University, Ürümqi, China
Key Laboratory of Signal Detection and Processing in Xinjiang Uygur Autonomous Region, Ürümqi, China
Key Laboratory of Software Engineering, Ürümqi, China
Hui Liu received the B.S. degree in software engineering in 2014, the M.E. degree in software engineering from the College of Software, Xinjiang University, Ürümqi, China, in 2017, where she is currently working toward the Ph.D. degree in computer science and technology.
Her research interests include deep learning and opportunistic networks and the processing of remote sensing image data.
Hui Liu received the B.S. degree in software engineering in 2014, the M.E. degree in software engineering from the College of Software, Xinjiang University, Ürümqi, China, in 2017, where she is currently working toward the Ph.D. degree in computer science and technology.
Her research interests include deep learning and opportunistic networks and the processing of remote sensing image data.View more
Author image of Minhang Yang
College of Software, Xinjiang University, Ürümqi, China
Key Laboratory of Signal Detection and Processing in Xinjiang Uygur Autonomous Region, Ürümqi, China
Key Laboratory of Software Engineering, Ürümqi, China
Minhang Yang received the bachelor’s degree in software engineering from the Xi’an University of Technology, Xi’an, China, in 2019. She is currently working toward the master’s degree in software engineering with Xinjiang University, Ürümqi, China.
Her research interests include deep learning and multilabel image classification.
Minhang Yang received the bachelor’s degree in software engineering from the Xi’an University of Technology, Xi’an, China, in 2019. She is currently working toward the master’s degree in software engineering with Xinjiang University, Ürümqi, China.
Her research interests include deep learning and multilabel image classification.View more
Author image of Yurong Qian
College of Software, Xinjiang University, Ürümqi, China
Key Laboratory of Signal Detection and Processing in Xinjiang Uygur Autonomous Region, Ürümqi, China
Key Laboratory of Software Engineering, Ürümqi, China
Yurong Qian received bachelor’s and master’s degrees in computer science and technology from Xinjiang University, Ürümqi, China, in 2000, and the doctorate degree in biology from Nanjing University, Nanjing, China, in 2010.
From 2012 to 2013, she was a Postdoctoral Fellow with the Department of Electronics and Computer Engineering, Hanyang University, South Korea. She is currently a Professor with the School of Software, X...Show More
Yurong Qian received bachelor’s and master’s degrees in computer science and technology from Xinjiang University, Ürümqi, China, in 2000, and the doctorate degree in biology from Nanjing University, Nanjing, China, in 2010.
From 2012 to 2013, she was a Postdoctoral Fellow with the Department of Electronics and Computer Engineering, Hanyang University, South Korea. She is currently a Professor with the School of Software, X...View more
Author image of Zhengqing Xiao
College of Mathematics and System Sciences, Xinjiang University, Ürümqi, China
Zhengqing Xiao received the Ph.D. degree in geographic information system from Beijing Normal University, Beijing, China, in 2011.
He is currently working with the College of Mathematics and System Sciences, Xinjiang University, Ürümqi, China. His research interests include big data analysis, image processing, and complex system modelling.
Zhengqing Xiao received the Ph.D. degree in geographic information system from Beijing Normal University, Beijing, China, in 2011.
He is currently working with the College of Mathematics and System Sciences, Xinjiang University, Ürümqi, China. His research interests include big data analysis, image processing, and complex system modelling.View more
Author image of Xiwu Zhong
College of Software, Xinjiang University, Ürümqi, China
Key Laboratory of Signal Detection and Processing in Xinjiang Uygur Autonomous Region, Ürümqi, China
Key Laboratory of Software Engineering, Ürümqi, China
Xiwu Zhong received the bachelor’s degree in network engineering from Huizhou University, Huizhou, China, in 2018. He is currently working toward the master’s degree, majoring in software engineering with Xinjiang University, Ürümqi, China.
His research interests include deep learning and remote sensing image processing.
Xiwu Zhong received the bachelor’s degree in network engineering from Huizhou University, Huizhou, China, in 2018. He is currently working toward the master’s degree, majoring in software engineering with Xinjiang University, Ürümqi, China.
His research interests include deep learning and remote sensing image processing.View more

Author image of Long Chen
College of Software, Xinjiang University, Ürümqi, China
Key Laboratory of Signal Detection and Processing in Xinjiang Uygur Autonomous Region, Ürümqi, China
Key Laboratory of Software Engineering, Ürümqi, China
Long Chen received the bachelor’s degree in geographic information science from the Shandong University of Science and Technology, Qingdao, China, in 2018. He is currently working toward the master’s degree in software engineering with Xinjiang University, Ürümqi, China.
His research interests include deep learning and single image super-resolution.
Long Chen received the bachelor’s degree in geographic information science from the Shandong University of Science and Technology, Qingdao, China, in 2018. He is currently working toward the master’s degree in software engineering with Xinjiang University, Ürümqi, China.
His research interests include deep learning and single image super-resolution.View more
Author image of Hui Liu
College of Information Science and Engineering, Xinjiang University, Ürümqi, China
Key Laboratory of Signal Detection and Processing in Xinjiang Uygur Autonomous Region, Ürümqi, China
Key Laboratory of Software Engineering, Ürümqi, China
Hui Liu received the B.S. degree in software engineering in 2014, the M.E. degree in software engineering from the College of Software, Xinjiang University, Ürümqi, China, in 2017, where she is currently working toward the Ph.D. degree in computer science and technology.
Her research interests include deep learning and opportunistic networks and the processing of remote sensing image data.
Hui Liu received the B.S. degree in software engineering in 2014, the M.E. degree in software engineering from the College of Software, Xinjiang University, Ürümqi, China, in 2017, where she is currently working toward the Ph.D. degree in computer science and technology.
Her research interests include deep learning and opportunistic networks and the processing of remote sensing image data.View more
Author image of Minhang Yang
College of Software, Xinjiang University, Ürümqi, China
Key Laboratory of Signal Detection and Processing in Xinjiang Uygur Autonomous Region, Ürümqi, China
Key Laboratory of Software Engineering, Ürümqi, China
Minhang Yang received the bachelor’s degree in software engineering from the Xi’an University of Technology, Xi’an, China, in 2019. She is currently working toward the master’s degree in software engineering with Xinjiang University, Ürümqi, China.
Her research interests include deep learning and multilabel image classification.
Minhang Yang received the bachelor’s degree in software engineering from the Xi’an University of Technology, Xi’an, China, in 2019. She is currently working toward the master’s degree in software engineering with Xinjiang University, Ürümqi, China.
Her research interests include deep learning and multilabel image classification.View more
Author image of Yurong Qian
College of Software, Xinjiang University, Ürümqi, China
Key Laboratory of Signal Detection and Processing in Xinjiang Uygur Autonomous Region, Ürümqi, China
Key Laboratory of Software Engineering, Ürümqi, China
Yurong Qian received bachelor’s and master’s degrees in computer science and technology from Xinjiang University, Ürümqi, China, in 2000, and the doctorate degree in biology from Nanjing University, Nanjing, China, in 2010.
From 2012 to 2013, she was a Postdoctoral Fellow with the Department of Electronics and Computer Engineering, Hanyang University, South Korea. She is currently a Professor with the School of Software, Xinjiang University. Her research interests include computational intelligence such as big data processing, image processing, and artificial neural networks.
Dr. Qian is a Senior Member of the Chinese Computer Federation. In 2015, she was trained as a Young Scientific and Technological Innovation Talent by the Science and Technology Department, Xinjiang, China.
Yurong Qian received bachelor’s and master’s degrees in computer science and technology from Xinjiang University, Ürümqi, China, in 2000, and the doctorate degree in biology from Nanjing University, Nanjing, China, in 2010.
From 2012 to 2013, she was a Postdoctoral Fellow with the Department of Electronics and Computer Engineering, Hanyang University, South Korea. She is currently a Professor with the School of Software, Xinjiang University. Her research interests include computational intelligence such as big data processing, image processing, and artificial neural networks.
Dr. Qian is a Senior Member of the Chinese Computer Federation. In 2015, she was trained as a Young Scientific and Technological Innovation Talent by the Science and Technology Department, Xinjiang, China.View more
Author image of Zhengqing Xiao
College of Mathematics and System Sciences, Xinjiang University, Ürümqi, China
Zhengqing Xiao received the Ph.D. degree in geographic information system from Beijing Normal University, Beijing, China, in 2011.
He is currently working with the College of Mathematics and System Sciences, Xinjiang University, Ürümqi, China. His research interests include big data analysis, image processing, and complex system modelling.
Zhengqing Xiao received the Ph.D. degree in geographic information system from Beijing Normal University, Beijing, China, in 2011.
He is currently working with the College of Mathematics and System Sciences, Xinjiang University, Ürümqi, China. His research interests include big data analysis, image processing, and complex system modelling.View more
Author image of Xiwu Zhong
College of Software, Xinjiang University, Ürümqi, China
Key Laboratory of Signal Detection and Processing in Xinjiang Uygur Autonomous Region, Ürümqi, China
Key Laboratory of Software Engineering, Ürümqi, China
Xiwu Zhong received the bachelor’s degree in network engineering from Huizhou University, Huizhou, China, in 2018. He is currently working toward the master’s degree, majoring in software engineering with Xinjiang University, Ürümqi, China.
His research interests include deep learning and remote sensing image processing.
Xiwu Zhong received the bachelor’s degree in network engineering from Huizhou University, Huizhou, China, in 2018. He is currently working toward the master’s degree, majoring in software engineering with Xinjiang University, Ürümqi, China.
His research interests include deep learning and remote sensing image processing.View more

References

References is not available for this document.