S2GCCFN: Shared-Specific Graph Construction-Oriented Crossmodal Fusion Network for HSI and LiDAR Data Joint Classification

The fusion of hyperspectral images (HSIs) and light detection and ranging (LiDAR) data reflects strong complementary advantages, significantly enhancing the accuracy and robustness of land cover classification. However, inherent differences in sensor mechanisms and imaging principles lead to substantial heterogeneity in feature representation and scene characterization between these two modalities, posing challenges for effective multisource remote sensing (RS) fusion. To address this issue, a shared-specific graph construction-oriented crossmodal fusion network (S2GCCFN) is proposed for HSI and LiDAR data joint classification. Our framework facilitates deep feature interaction between heterogeneous HSI and LiDAR data to achieve modal homogenization, yielding a high-performance joint representation. The core motivation of this study is to capture one assimilation modality (AM) by discovering latent crossmodal mapping strategies from both HSI and LiDAR data simultaneously. Notably, S2GCCFN mitigates modal heterogeneity while enhancing complementary information exchange. S2GCCFN considers one dynamic graph mapping mechanism that adaptively integrates intramodal and crossmodal features comprehensively to align dual RS modalities and promote RS interaction. By establishing shared feature spaces, S2GCCFN enhances intermodal consistency while preserving modality-specific characteristics, ultimately generating highly discriminative AMs for joint classification. Furthermore, S2GCCFN incorporates an AM reconstruction decoder to jointly address modality reconstruction and classification. Experimental results demonstrate that S2GCCFN outperforms state-of-the-art techniques, improving overall accuracy (OA) by 2.66% and 1.34% on average on both datasets, respectively.