HGR Maximal Correlation Augmented Cross-Modal Remote Sensing Retrieval

Most existing methods for cross-modal content-based remote sensing image retrieval (CM-CBRSIR) have only focused on implementations by optimizing the projected features in a common space under the Euclidean distance criterion. In this work, to better bridge the heterogeneity gap caused by the modality difference, we propose a Hirschfeld–Gebelein–Rényi (HGR) maximal correlation augmented CM-CBRSIR method by utilizing the HGR maximal correlation between different modalities. Except for optimizing the projected features under the Euclidean distance constraints, another feature projection, which carries the information of the HGR maximal correlation, is learned during the training phase. In the retrieval phase, we combine the information learned by the Euclidean distance criterion and HGR maximal correlation based on the Dempster–Shafer (DS) evidence theory. Experimental results show that the proposed method outperforms the existing state-of-the-art methods.
¹