Abstract:
Synthetic aperture radar (SAR) plays an essential role in earth observation and projection due to its capability to penetrate clouds, which makes it possible to monitor t...Show MoreMetadata
Abstract:
Synthetic aperture radar (SAR) plays an essential role in earth observation and projection due to its capability to penetrate clouds, which makes it possible to monitor terrestrial surfaces under all weather conditions. Multiplicative noise often occurs in the SAR signal, hampering the retrieval of information from SAR imagery. Convolutional neural networks (CNNs) have been used in many computer vision tasks and are helpful in image denoising. However, current CNN-based denoising approaches inevitably lead to a “washed out” effect that loses spatial details. Another limitation is that most typical CNN-based denoising models require a noise-free image for training. To address these issues, we propose a novel end-to-end self-supervised SAR denoising model: Enhanced Noise2Noise (EN2N), which can be trained without a noise-free image. To enhance the quality of the result images, the perceptual features from a pre-learned CNN are introduced to restore the spatial details by a hybrid loss function. Experiments show that our proposed method outperforms the typical denoising methods in terms of noise reduction and feature preservation based on image quality metrics. Also, the new hybrid loss could enhance the spatial details significantly. The good performance maintains the robustness throughout time, which reduces the uncertainty in time-series SAR caused by random noise. Benefiting from optimization of graphics processing unit (GPU) and multi-threading, the proposed method has higher computation efficiency than traditional methods. This study demonstrates the great potential of using our self-supervised deep learning approaches for SAR image denoising in the future.
Published in: IEEE Transactions on Geoscience and Remote Sensing ( Volume: 60)
Funding Agency:

Department of Earth System Science, Tsinghua University, Beijing, China
Shen Tan received the B.S. degree from Northwest University, Xi’an, China, in 2014 and the Ph.D. degree from the Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing, China, in 2019.
He is currently a Post-Doctoral Research Fellow with the Department of Earth System Science, Tsinghua University, Beijing. His research interests include simulating terrestrial carbon and hydrological processes b...Show More
Shen Tan received the B.S. degree from Northwest University, Xi’an, China, in 2014 and the Ph.D. degree from the Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing, China, in 2019.
He is currently a Post-Doctoral Research Fellow with the Department of Earth System Science, Tsinghua University, Beijing. His research interests include simulating terrestrial carbon and hydrological processes b...View more

Department of Computing and Mathematics, Manchester Metropolitan University, Manchester, U.K.
Xin Zhang received the B.S. degree from the PLA Academy of Communication and Commanding, Wuhan, China, in 2009, and the Ph.D. degree in cartography and geographic information system from Beijing Normal University (BNU), Beijing, China, in 2014.
He is currently an Associate Researcher with Manchester Metropolitan University (MMU), Manchester, U.K. His research interests include remote sensing image processing and deep learn...Show More
Xin Zhang received the B.S. degree from the PLA Academy of Communication and Commanding, Wuhan, China, in 2009, and the Ph.D. degree in cartography and geographic information system from Beijing Normal University (BNU), Beijing, China, in 2014.
He is currently an Associate Researcher with Manchester Metropolitan University (MMU), Manchester, U.K. His research interests include remote sensing image processing and deep learn...View more

Department of Earth System Science, Tsinghua University, Beijing, China
Han Wang received the B.S. degree from Shaanxi Normal University, Xi’an, China, in 2006, and the Ph.D. degree in plant ecology from the Institute of Botany, Chinese Academy of Sciences, Beijing, China, in 2011, and Macquarie University, Sydney, NSW, Australia, in 2013.
She is currently an Associate Professor with the Department of Earth System Science, Tsinghua University, Beijing. Her research interests include plant mode...Show More
Han Wang received the B.S. degree from Shaanxi Normal University, Xi’an, China, in 2006, and the Ph.D. degree in plant ecology from the Institute of Botany, Chinese Academy of Sciences, Beijing, China, in 2011, and Macquarie University, Sydney, NSW, Australia, in 2013.
She is currently an Associate Professor with the Department of Earth System Science, Tsinghua University, Beijing. Her research interests include plant mode...View more

Department of Earth System Science, Tsinghua University, Beijing, China
Le Yu (Senior Member, IEEE) received the B.S. degree in geographical information system and the Ph.D. degree in remote sensing from Zhejiang University, Hangzhou, China, in 2005 and 2010, respectively.
He is currently an Associate Professor with the Department of Earth System Science, Tsinghua University, Beijing, China. His research interests include global land cover/use mapping, simulation, and applications.
Dr. Yu is an...Show More
Le Yu (Senior Member, IEEE) received the B.S. degree in geographical information system and the Ph.D. degree in remote sensing from Zhejiang University, Hangzhou, China, in 2005 and 2010, respectively.
He is currently an Associate Professor with the Department of Earth System Science, Tsinghua University, Beijing, China. His research interests include global land cover/use mapping, simulation, and applications.
Dr. Yu is an...View more

Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing, China
Yanlei Du (Member, IEEE) received the B.S. degree from Chang’an University, Xi’an, China, in 2014, and the Ph.D. degree from the Institute of Remote Sensing and Digital Earth (RADI), Chinese Academy of Sciences (CAS), Beijing, China, in 2019.
From 2019 to 2021, he was a Post-Doctoral Research Fellow with the Department of Electronic Engineering, Tsinghua University, Beijing. He is currently an Assistant Professor with the ...Show More
Yanlei Du (Member, IEEE) received the B.S. degree from Chang’an University, Xi’an, China, in 2014, and the Ph.D. degree from the Institute of Remote Sensing and Digital Earth (RADI), Chinese Academy of Sciences (CAS), Beijing, China, in 2019.
From 2019 to 2021, he was a Post-Doctoral Research Fellow with the Department of Electronic Engineering, Tsinghua University, Beijing. He is currently an Assistant Professor with the ...View more

School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing, China
Junjun Yin (Senior Member, IEEE) received the Ph.D. degree in information and communication engineering from Tsinghua University, Beijing, China, in 2013.
From 2013 to 2015, she was a Post-Doctoral Research Fellow with the Department of Electronic Engineering, Tsinghua University, and the Department of Geological Sciences, University of Manitoba, Winnipeg, MB, Canada. She is currently a Faculty Member with the School of Co...Show More
Junjun Yin (Senior Member, IEEE) received the Ph.D. degree in information and communication engineering from Tsinghua University, Beijing, China, in 2013.
From 2013 to 2015, she was a Post-Doctoral Research Fellow with the Department of Electronic Engineering, Tsinghua University, and the Department of Geological Sciences, University of Manitoba, Winnipeg, MB, Canada. She is currently a Faculty Member with the School of Co...View more

Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing, China
Bingfang Wu received the B.S. degree from Nanchang University, Nanchang, China, in 1982, and the Ph.D. degree from Tsinghua University, Beijing, China, in 1989.
He is currently a Professor with the State Key Laboratory of Remote Sensing Science, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing. He has been working with the remote sensing application in agricultural monitoring and water resourc...Show More
Bingfang Wu received the B.S. degree from Nanchang University, Nanchang, China, in 1982, and the Ph.D. degree from Tsinghua University, Beijing, China, in 1989.
He is currently a Professor with the State Key Laboratory of Remote Sensing Science, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing. He has been working with the remote sensing application in agricultural monitoring and water resourc...View more

Department of Earth System Science, Tsinghua University, Beijing, China
Shen Tan received the B.S. degree from Northwest University, Xi’an, China, in 2014 and the Ph.D. degree from the Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing, China, in 2019.
He is currently a Post-Doctoral Research Fellow with the Department of Earth System Science, Tsinghua University, Beijing. His research interests include simulating terrestrial carbon and hydrological processes based on remote sensing input and deep learning technology.
Shen Tan received the B.S. degree from Northwest University, Xi’an, China, in 2014 and the Ph.D. degree from the Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing, China, in 2019.
He is currently a Post-Doctoral Research Fellow with the Department of Earth System Science, Tsinghua University, Beijing. His research interests include simulating terrestrial carbon and hydrological processes based on remote sensing input and deep learning technology.View more

Department of Computing and Mathematics, Manchester Metropolitan University, Manchester, U.K.
Xin Zhang received the B.S. degree from the PLA Academy of Communication and Commanding, Wuhan, China, in 2009, and the Ph.D. degree in cartography and geographic information system from Beijing Normal University (BNU), Beijing, China, in 2014.
He is currently an Associate Researcher with Manchester Metropolitan University (MMU), Manchester, U.K. His research interests include remote sensing image processing and deep learning.
Xin Zhang received the B.S. degree from the PLA Academy of Communication and Commanding, Wuhan, China, in 2009, and the Ph.D. degree in cartography and geographic information system from Beijing Normal University (BNU), Beijing, China, in 2014.
He is currently an Associate Researcher with Manchester Metropolitan University (MMU), Manchester, U.K. His research interests include remote sensing image processing and deep learning.View more

Department of Earth System Science, Tsinghua University, Beijing, China
Han Wang received the B.S. degree from Shaanxi Normal University, Xi’an, China, in 2006, and the Ph.D. degree in plant ecology from the Institute of Botany, Chinese Academy of Sciences, Beijing, China, in 2011, and Macquarie University, Sydney, NSW, Australia, in 2013.
She is currently an Associate Professor with the Department of Earth System Science, Tsinghua University, Beijing. Her research interests include plant modeling vegetation dynamics and the global carbon cycle based on the remote sensing observation.
Han Wang received the B.S. degree from Shaanxi Normal University, Xi’an, China, in 2006, and the Ph.D. degree in plant ecology from the Institute of Botany, Chinese Academy of Sciences, Beijing, China, in 2011, and Macquarie University, Sydney, NSW, Australia, in 2013.
She is currently an Associate Professor with the Department of Earth System Science, Tsinghua University, Beijing. Her research interests include plant modeling vegetation dynamics and the global carbon cycle based on the remote sensing observation.View more

Department of Earth System Science, Tsinghua University, Beijing, China
Le Yu (Senior Member, IEEE) received the B.S. degree in geographical information system and the Ph.D. degree in remote sensing from Zhejiang University, Hangzhou, China, in 2005 and 2010, respectively.
He is currently an Associate Professor with the Department of Earth System Science, Tsinghua University, Beijing, China. His research interests include global land cover/use mapping, simulation, and applications.
Dr. Yu is an Associate Editor of International Journal of Remote Sensing and the Section Editor-in-Chief of Land. He has served as a member of Editorial Board and a referee for many international journals.
Le Yu (Senior Member, IEEE) received the B.S. degree in geographical information system and the Ph.D. degree in remote sensing from Zhejiang University, Hangzhou, China, in 2005 and 2010, respectively.
He is currently an Associate Professor with the Department of Earth System Science, Tsinghua University, Beijing, China. His research interests include global land cover/use mapping, simulation, and applications.
Dr. Yu is an Associate Editor of International Journal of Remote Sensing and the Section Editor-in-Chief of Land. He has served as a member of Editorial Board and a referee for many international journals.View more

Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing, China
Yanlei Du (Member, IEEE) received the B.S. degree from Chang’an University, Xi’an, China, in 2014, and the Ph.D. degree from the Institute of Remote Sensing and Digital Earth (RADI), Chinese Academy of Sciences (CAS), Beijing, China, in 2019.
From 2019 to 2021, he was a Post-Doctoral Research Fellow with the Department of Electronic Engineering, Tsinghua University, Beijing. He is currently an Assistant Professor with the State Key Laboratory of Remote Sensing Science, Aerospace Information Research Institute, CAS. His research interests include computational electromagnetics in applications of ocean remote sensing, radar polarimetry, and satellite oceanography.
Yanlei Du (Member, IEEE) received the B.S. degree from Chang’an University, Xi’an, China, in 2014, and the Ph.D. degree from the Institute of Remote Sensing and Digital Earth (RADI), Chinese Academy of Sciences (CAS), Beijing, China, in 2019.
From 2019 to 2021, he was a Post-Doctoral Research Fellow with the Department of Electronic Engineering, Tsinghua University, Beijing. He is currently an Assistant Professor with the State Key Laboratory of Remote Sensing Science, Aerospace Information Research Institute, CAS. His research interests include computational electromagnetics in applications of ocean remote sensing, radar polarimetry, and satellite oceanography.View more

School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing, China
Junjun Yin (Senior Member, IEEE) received the Ph.D. degree in information and communication engineering from Tsinghua University, Beijing, China, in 2013.
From 2013 to 2015, she was a Post-Doctoral Research Fellow with the Department of Electronic Engineering, Tsinghua University, and the Department of Geological Sciences, University of Manitoba, Winnipeg, MB, Canada. She is currently a Faculty Member with the School of Computer and Communication Engineering, University of Science and Technology Beijing (USTB), Beijing. Her research interests include polarimetric SAR image interpretation, compact polarimetry, ship detection, and oil spill observation, change detection, and polarimetric SAR image classification and segmentation.
Junjun Yin (Senior Member, IEEE) received the Ph.D. degree in information and communication engineering from Tsinghua University, Beijing, China, in 2013.
From 2013 to 2015, she was a Post-Doctoral Research Fellow with the Department of Electronic Engineering, Tsinghua University, and the Department of Geological Sciences, University of Manitoba, Winnipeg, MB, Canada. She is currently a Faculty Member with the School of Computer and Communication Engineering, University of Science and Technology Beijing (USTB), Beijing. Her research interests include polarimetric SAR image interpretation, compact polarimetry, ship detection, and oil spill observation, change detection, and polarimetric SAR image classification and segmentation.View more

Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing, China
Bingfang Wu received the B.S. degree from Nanchang University, Nanchang, China, in 1982, and the Ph.D. degree from Tsinghua University, Beijing, China, in 1989.
He is currently a Professor with the State Key Laboratory of Remote Sensing Science, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing. He has been working with the remote sensing application in agricultural monitoring and water resources management. He has published more than 400 articles in peer-reviewed journals.
Dr. Wu is the Co-Chair of the Global Earth Observation Global Agricultural Monitoring (GEOGLAM) Flagship.
Bingfang Wu received the B.S. degree from Nanchang University, Nanchang, China, in 1982, and the Ph.D. degree from Tsinghua University, Beijing, China, in 1989.
He is currently a Professor with the State Key Laboratory of Remote Sensing Science, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing. He has been working with the remote sensing application in agricultural monitoring and water resources management. He has published more than 400 articles in peer-reviewed journals.
Dr. Wu is the Co-Chair of the Global Earth Observation Global Agricultural Monitoring (GEOGLAM) Flagship.View more