Dual-path Prototype Feature Decoupling Alignment Network for Panchromatic and Multispectral Classification

In recent years, with the rapid advancements and widespread application of satellite photography technology, it has become increasingly possible to obtain high-quality panchromatic (PAN) and multispectral (MS) data, which has provided new opportunities and challenges for multi-source information fusion and classification research. Remote sensing data has the characteristics of small inter-class differences and large intra-class differences, which easily leads to category confusion in network learning. In addition, how to fully tap the advantages of multi-source data, better align multi-source features, improve classification accuracy, and achieve collaborative classification are key issues that need to be solved urgently. In this paper, a dual-path prototype feature decoupling alignment network (DPFDA-Net) is designed to solve the above issues. The network consists of two components: a prototype feature embedding module (PFE) and a feature alignment module (FAM) based on prototype decoupling. In the feature extraction stage, the PFE module uses the prototype concept to learn the discriminative prototype features of each category of the dual-source data separately, making the boundaries between categories more obvious. The FAM operates at the dual-source prototype feature level and achieves feature alignment by decoupling single-source prototype features and performing feature transformation to supplement the missing information of another data source. Finally, we use the aligned features for classification. The results of the experiment demonstrate that our approach has made significant progress in improving classification precision. The code is available at https://github.com/Xidian-AIGroup190726/DPFDANet.