SSCAConv: Self-Guided Spatial-Channel Adaptive Convolution for Image Fusion | IEEE Journals & Magazine | IEEE Xplore

SSCAConv: Self-Guided Spatial-Channel Adaptive Convolution for Image Fusion


Abstract:

Pansharpening, which attempts to obtain a high-resolution multispectral (HR-MS) image by fusing a panchromatic (PAN) image with a low-resolution multispectral (LR-MS) ima...Show More

Abstract:

Pansharpening, which attempts to obtain a high-resolution multispectral (HR-MS) image by fusing a panchromatic (PAN) image with a low-resolution multispectral (LR-MS) image, is a critical yet difficult remote sensing image processing task. In this study, we present a novel convolution operation, self-guided spatial-channel adaptive convolution (SSCAConv), for pansharpening. Unlike the reported adaptive convolutions that only focus on spatial details, our SSCAConv also considers channel specificity by generating an individual convolution kernel for each channel patch according to its own content and supplements the interchannel information by introducing a global bias. We further apply the designed SSCAConv to a simple residual network architecture to construct the image fusion network (SSCANet). Experimental results show that SSCANet outperforms state-of-the-art (SOTA) pansharpening algorithms and achieves better generalization ability with fewer parameters. In addition, our network also yields the best results when extended to the hyperspectral image super-resolution (HISR) problem. The code is available at https://github.com/Pluto-wei/SSCAConv.
Published in: IEEE Geoscience and Remote Sensing Letters ( Volume: 21)
Article Sequence Number: 5000705
Date of Publication: 20 December 2023

ISSN Information:

Funding Agency:


Contact IEEE to Subscribe

References

References is not available for this document.