Loading [MathJax]/extensions/MathMenu.js
Content-Adaptive Multi-Region Deep Network for Polarimetric SAR Image Classification | IEEE Journals & Magazine | IEEE Xplore

Content-Adaptive Multi-Region Deep Network for Polarimetric SAR Image Classification


Abstract:

Deep learning methods excel in Polarimetric SAR (PolSAR) image classification. However, existing methods typically sample an image block for each pixel with a fixed-size ...Show More

Abstract:

Deep learning methods excel in Polarimetric SAR (PolSAR) image classification. However, existing methods typically sample an image block for each pixel with a fixed-size square window, which always contains inconsistent/incomplete content with the central pixel, resulting in many misclassifications especially in boundary and heterogeneous regions. So, a size-fixed square window is not enough for representing various terrain objects. To address this issue, we develop a content-adaptive multi-region deep network to obtain contextual consistent sampling windows for diverse terrain objects. Firstly, a complex scene of PolSAR image is partitioned into homogeneous, heterogeneous and boundary regions. Then, sampling windows with adaptive direction and scale are designed for three distinct regions. Besides, windows with central and global regions are proposed to provide additional local and global information. Finally, a fusion network is designed to adaptively combine different sampling windows to enhance classification performance. Experimental results on three real data sets demonstrate that the proposed method can achieve superior performance in both edge details and heterogeneous terrain objects compared with the state-of-the-art methods.
Page(s): 617 - 631
Date of Publication: 09 September 2024

ISSN Information:

Funding Agency:

Author image of Junfei Shi
Department of Computer Science and Technology, Shaanxi Key Laboratory for Network Computing and Security Technology, Xi’an University of Technology, Xi’an, China
Junfei Shi (Member, IEEE) received the B.S. degree in computer science and technology from Henan Normal University, Henan, China, in 2009, and the Ph.D. degree in computer science and technology from Xidian University, Xi’an, China, in 2016.
She is currently a Lecturer with the School of Computer Science and Engineering, Xi’an University of Technology, Xi’an. Her current research interests include polarimetric SAR image cl...Show More
Junfei Shi (Member, IEEE) received the B.S. degree in computer science and technology from Henan Normal University, Henan, China, in 2009, and the Ph.D. degree in computer science and technology from Xidian University, Xi’an, China, in 2016.
She is currently a Lecturer with the School of Computer Science and Engineering, Xi’an University of Technology, Xi’an. Her current research interests include polarimetric SAR image cl...View more
Author image of Shanshan Ji
Department of Computer Science and Technology, Shaanxi Key Laboratory for Network Computing and Security Technology, Xi’an University of Technology, Xi’an, China
Shanshan Ji (Graduate Student Member, IEEE) received the B.E. degree in network engineering from Xuchang University, Henan, China, in 2022. She is currently pursuing the M.E. degree in computer technology with Xi’an University of Technology, China.
Her research interests include deep learning and polarimetric synthetic aperture radar (PolSAR) image classification.
Shanshan Ji (Graduate Student Member, IEEE) received the B.E. degree in network engineering from Xuchang University, Henan, China, in 2022. She is currently pursuing the M.E. degree in computer technology with Xi’an University of Technology, China.
Her research interests include deep learning and polarimetric synthetic aperture radar (PolSAR) image classification.View more
Author image of Haiyan Jin
Department of Computer Science and Technology, Shaanxi Key Laboratory for Network Computing and Security Technology, Xi’an University of Technology, Xi’an, China
Haiyan Jin (Member, IEEE) received the Ph.D. degree from Xidian University, China, in 2007.
She is currently a Professor with Xi’an University of Technology. She is the Leader of Shaanxi University Youth Innovation Team. She has published more than 100 papers in journals and important international conferences, hosted more than ten National Natural Science Foundation projects and Shaanxi Province scientific research projec...Show More
Haiyan Jin (Member, IEEE) received the Ph.D. degree from Xidian University, China, in 2007.
She is currently a Professor with Xi’an University of Technology. She is the Leader of Shaanxi University Youth Innovation Team. She has published more than 100 papers in journals and important international conferences, hosted more than ten National Natural Science Foundation projects and Shaanxi Province scientific research projec...View more
Author image of Junhuai Li
Department of Computer Science and Technology, Shaanxi Key Laboratory for Network Computing and Security Technology, Xi’an University of Technology, Xi’an, China
Junhuai Li (Member, IEEE) received the B.S. degree in electrical automation from Shaanxi Institute of Mechanical Engineering, Xi’an, China, in 1992, the M.S. degree in computer application technology from Xi’an University of Technology, Xi’an, in 1999, and the Ph.D. degree in computer software and theory from Northwest University, Xi’an, in 2002.
He is currently a Professor with the School of Computer Science and Engineeri...Show More
Junhuai Li (Member, IEEE) received the B.S. degree in electrical automation from Shaanxi Institute of Mechanical Engineering, Xi’an, China, in 1992, the M.S. degree in computer application technology from Xi’an University of Technology, Xi’an, in 1999, and the Ph.D. degree in computer software and theory from Northwest University, Xi’an, in 2002.
He is currently a Professor with the School of Computer Science and Engineeri...View more
Author image of Maoguo Gong
School of Electronic Engineering, Xidian University, Xi’an, China
Maoguo Gong (Fellow, IEEE) received the B.S. degree (Hons.) in electronic engineering and the Ph.D. degree in electronic science and technology from Xidian University, Xi’an, China, in 2003 and 2009, respectively.
Since 2006, he has been a Teacher with Xidian University. He was promoted as an Associate Professor and a Full Professor, in 2008 and 2010, respectively, both with exceptive admission. His research interests incl...Show More
Maoguo Gong (Fellow, IEEE) received the B.S. degree (Hons.) in electronic engineering and the Ph.D. degree in electronic science and technology from Xidian University, Xi’an, China, in 2003 and 2009, respectively.
Since 2006, he has been a Teacher with Xidian University. He was promoted as an Associate Professor and a Full Professor, in 2008 and 2010, respectively, both with exceptive admission. His research interests incl...View more
Author image of Weisi Lin
School of Computer Science and Engineering, Nanyang Technological University, Jurong West, Singapore
Weisi Lin (Fellow, IEEE) received the bachelor’s degree in electronics and the master’s degree in digital signal processing from Sun Yat-sen University, Guangzhou, China, and the Ph.D. degree in computer vision from King’s College London, U.K.
He is currently a Professor with the School of Computer Science and Engineering, Nanyang Technological University, Singapore. His research interests include image processing, percept...Show More
Weisi Lin (Fellow, IEEE) received the bachelor’s degree in electronics and the master’s degree in digital signal processing from Sun Yat-sen University, Guangzhou, China, and the Ph.D. degree in computer vision from King’s College London, U.K.
He is currently a Professor with the School of Computer Science and Engineering, Nanyang Technological University, Singapore. His research interests include image processing, percept...View more

Author image of Junfei Shi
Department of Computer Science and Technology, Shaanxi Key Laboratory for Network Computing and Security Technology, Xi’an University of Technology, Xi’an, China
Junfei Shi (Member, IEEE) received the B.S. degree in computer science and technology from Henan Normal University, Henan, China, in 2009, and the Ph.D. degree in computer science and technology from Xidian University, Xi’an, China, in 2016.
She is currently a Lecturer with the School of Computer Science and Engineering, Xi’an University of Technology, Xi’an. Her current research interests include polarimetric SAR image classification, semantic model, and computer vision.
Junfei Shi (Member, IEEE) received the B.S. degree in computer science and technology from Henan Normal University, Henan, China, in 2009, and the Ph.D. degree in computer science and technology from Xidian University, Xi’an, China, in 2016.
She is currently a Lecturer with the School of Computer Science and Engineering, Xi’an University of Technology, Xi’an. Her current research interests include polarimetric SAR image classification, semantic model, and computer vision.View more
Author image of Shanshan Ji
Department of Computer Science and Technology, Shaanxi Key Laboratory for Network Computing and Security Technology, Xi’an University of Technology, Xi’an, China
Shanshan Ji (Graduate Student Member, IEEE) received the B.E. degree in network engineering from Xuchang University, Henan, China, in 2022. She is currently pursuing the M.E. degree in computer technology with Xi’an University of Technology, China.
Her research interests include deep learning and polarimetric synthetic aperture radar (PolSAR) image classification.
Shanshan Ji (Graduate Student Member, IEEE) received the B.E. degree in network engineering from Xuchang University, Henan, China, in 2022. She is currently pursuing the M.E. degree in computer technology with Xi’an University of Technology, China.
Her research interests include deep learning and polarimetric synthetic aperture radar (PolSAR) image classification.View more
Author image of Haiyan Jin
Department of Computer Science and Technology, Shaanxi Key Laboratory for Network Computing and Security Technology, Xi’an University of Technology, Xi’an, China
Haiyan Jin (Member, IEEE) received the Ph.D. degree from Xidian University, China, in 2007.
She is currently a Professor with Xi’an University of Technology. She is the Leader of Shaanxi University Youth Innovation Team. She has published more than 100 papers in journals and important international conferences, hosted more than ten National Natural Science Foundation projects and Shaanxi Province scientific research projects. Her research interests include computer vision, image processing, and intelligent optimization. She is the winner of Shaanxi Youth Science and Technology Award.
Haiyan Jin (Member, IEEE) received the Ph.D. degree from Xidian University, China, in 2007.
She is currently a Professor with Xi’an University of Technology. She is the Leader of Shaanxi University Youth Innovation Team. She has published more than 100 papers in journals and important international conferences, hosted more than ten National Natural Science Foundation projects and Shaanxi Province scientific research projects. Her research interests include computer vision, image processing, and intelligent optimization. She is the winner of Shaanxi Youth Science and Technology Award.View more
Author image of Junhuai Li
Department of Computer Science and Technology, Shaanxi Key Laboratory for Network Computing and Security Technology, Xi’an University of Technology, Xi’an, China
Junhuai Li (Member, IEEE) received the B.S. degree in electrical automation from Shaanxi Institute of Mechanical Engineering, Xi’an, China, in 1992, the M.S. degree in computer application technology from Xi’an University of Technology, Xi’an, in 1999, and the Ph.D. degree in computer software and theory from Northwest University, Xi’an, in 2002.
He is currently a Professor with the School of Computer Science and Engineering, Xi’an University of Technology. His research interests include the Internet of Things technology and network computing.
Junhuai Li (Member, IEEE) received the B.S. degree in electrical automation from Shaanxi Institute of Mechanical Engineering, Xi’an, China, in 1992, the M.S. degree in computer application technology from Xi’an University of Technology, Xi’an, in 1999, and the Ph.D. degree in computer software and theory from Northwest University, Xi’an, in 2002.
He is currently a Professor with the School of Computer Science and Engineering, Xi’an University of Technology. His research interests include the Internet of Things technology and network computing.View more
Author image of Maoguo Gong
School of Electronic Engineering, Xidian University, Xi’an, China
Maoguo Gong (Fellow, IEEE) received the B.S. degree (Hons.) in electronic engineering and the Ph.D. degree in electronic science and technology from Xidian University, Xi’an, China, in 2003 and 2009, respectively.
Since 2006, he has been a Teacher with Xidian University. He was promoted as an Associate Professor and a Full Professor, in 2008 and 2010, respectively, both with exceptive admission. His research interests include computational intelligence with applications to optimization, learning, data mining, and image understanding. He received the Excellent Young Scientist Foundation Program from the National Natural Science Foundation of China and the New Century Excellent Talent in University from the Ministry of Education of China. He is an Associate Editor of IEEE Transactions on Evolutionary Computation and IEEE Transactions on Neural Networks and Learning Systems.
Maoguo Gong (Fellow, IEEE) received the B.S. degree (Hons.) in electronic engineering and the Ph.D. degree in electronic science and technology from Xidian University, Xi’an, China, in 2003 and 2009, respectively.
Since 2006, he has been a Teacher with Xidian University. He was promoted as an Associate Professor and a Full Professor, in 2008 and 2010, respectively, both with exceptive admission. His research interests include computational intelligence with applications to optimization, learning, data mining, and image understanding. He received the Excellent Young Scientist Foundation Program from the National Natural Science Foundation of China and the New Century Excellent Talent in University from the Ministry of Education of China. He is an Associate Editor of IEEE Transactions on Evolutionary Computation and IEEE Transactions on Neural Networks and Learning Systems.View more
Author image of Weisi Lin
School of Computer Science and Engineering, Nanyang Technological University, Jurong West, Singapore
Weisi Lin (Fellow, IEEE) received the bachelor’s degree in electronics and the master’s degree in digital signal processing from Sun Yat-sen University, Guangzhou, China, and the Ph.D. degree in computer vision from King’s College London, U.K.
He is currently a Professor with the School of Computer Science and Engineering, Nanyang Technological University, Singapore. His research interests include image processing, perceptual modeling, video compression, multimedia communication, and computer vision. He is a fellow of IET, an Honorary Fellow of Singapore Institute of Engineering Technologists, and a Chartered Engineer in U.K. He was awarded as a Distinguished Lecturer of the IEEE Circuits and Systems Society from 2016 to 2017. He was the Chair of the IEEE MMTC Special Interest Group on Quality of Experience. He served or serves as an Associate Editor for IEEE Transactions on Image Processing, IEEE Transactions on Circuits and Systems for Video Technology, IEEE Transactions on Multimedia, IEEE Signal Processing Letters, and Journal of Visual Communication and Image Representation.
Weisi Lin (Fellow, IEEE) received the bachelor’s degree in electronics and the master’s degree in digital signal processing from Sun Yat-sen University, Guangzhou, China, and the Ph.D. degree in computer vision from King’s College London, U.K.
He is currently a Professor with the School of Computer Science and Engineering, Nanyang Technological University, Singapore. His research interests include image processing, perceptual modeling, video compression, multimedia communication, and computer vision. He is a fellow of IET, an Honorary Fellow of Singapore Institute of Engineering Technologists, and a Chartered Engineer in U.K. He was awarded as a Distinguished Lecturer of the IEEE Circuits and Systems Society from 2016 to 2017. He was the Chair of the IEEE MMTC Special Interest Group on Quality of Experience. He served or serves as an Associate Editor for IEEE Transactions on Image Processing, IEEE Transactions on Circuits and Systems for Video Technology, IEEE Transactions on Multimedia, IEEE Signal Processing Letters, and Journal of Visual Communication and Image Representation.View more

Contact IEEE to Subscribe

References

References is not available for this document.