Fusion of Hyperspectral and Panchromatic Images using Structure Tensor

In this paper, a new hyperspectral image fusion method with structure tensor is proposed. The proposed method utilizes PCA transformation to obtain the spatial details of HS image. Then, an image enhancement approach is applied to the PAN image to sharpen spatial information. Since structure tensor represents structure and spatial information, structure tensor is introduced to extract spatial details of the enhanced PAN image. Unlike traditional methods which extract details only from PAN image, the proposed method considers spatial details of the HS and PAN images simultaneously, and a weighted fusion method is presented to integrate spatial details of the two images to obtain complete spatial details. Finally, an injection gains matrix is constructed to reduce spectral and spatial distortion, and the fused image is generated by injecting the complete spatial information. Experimental results demonstrate that the proposed method obtains the excellent performance in both objective and subjective evaluations.