SDST: Self-Supervised Double-Structure Transformer for Hyperspectral Images Clustering

Due to the lack of labeled information and the high spectral variability in high-dimensional hyperspectral images (HSIs), HSI clustering has emerged as an effective unsupervised approach for HSI information extraction and classification. Deep clustering methods have achieved significant success in unsupervised HSI classification (HSIC) and have gained increasing attention. However, these methods have limitations in terms of robustness, adaptability, and feature representation when dealing with complex large-scale HSI datasets. Therefore, this article introduced a novel self-supervised double-structure transformer (SDST) approach for HSI clustering. Specifically, in our approach, we designed a shared autoformer structure based on an autoencoder to learn the global properties of HSI data by fusing the multilevel features from the autoencoder with the transformer. Furthermore, we proposed a Siamese dual-former graph module (DFGM) with superpixel-level features for fewer nodes, which reveals long-dependency graph convolutional features, resulting in more precise graph structure features. By constructing a graph with long-dependencies, this module significantly preserves the properties of global dependencies, while focusing on the local features of each superpixel to better represent the fine-grained local details. Finally, we designed a joint optimization module to jointly optimize the double-structure model composed of the shared autoformer module and the Siamese DFGM. To validate the effectiveness of the proposed SDST method, we conducted a series of experiments on the Salinas, Botswana, Indian Pines, and Houston2013 datasets. The proposed SDST achieves competitive clustering accuracies compared with the state-of-the-art clustering methods. The codes are available at
https://github.com/YiLiu1999/SDST
.