Abstract:Hyperspectral image (HSI) classification is an important topic in remote sensing tasks, aiming to exploit the spectral and spatial information in HSI to assign category labels to each pixel. Recently, numerous deep learning (DL) methods, such as convolutional neural network (CNN) and transformer, have been introduced and achieved promising results. These DL-based models tend to use patch-based input patterns, where a patch is extracted around a central pixel and the neighboring pixels serve as auxiliary roles. However, compared to developing novel models, the characteristics of the patch-based HSI classification framework have not been adequately explored. Most existing patch-based DL methods tend to overlook the potential relationships between the central pixel and its neighboring pixels. In addition, the unique spectral characteristics of HSI (e.g., adjacent bands possess higher correlation) require special attention. Moreover, the design of feature extractors for HSIs appears to be constrained primarily to the spatial and spectral domains. To cope with the above problems, we propose an HSI classification specifically designed model (HSIC-SDM), which encompasses three branches—frequency feature learning, spatial feature learning, and spectral feature learning. The frequency feature learning branch employs a Fourier-based feature extractor to acquire representations in the frequency domain. The spatial feature learning branch emphasizes the significance of central pixel and edge information. The spectral feature learning branch concerns the high correlations in the adjacent spectral bands. Multidomain features derived from three branches provide diverse perspectives for the final classification. Extensive experiments on three datasets demonstrate the superiority of the proposed method over the state-of-the-art (SOTA) compared methods. The code of our work will be available publicly at https://github.com/Tikiten/HSIC-SDM.

SDST: Self-Supervised Double-Structure Transformer for Hyperspectral Images Clustering

Graph-Based Structural Deep Spectral-Spatial Clustering for Hyperspectral Image

Deep Spatial-Spectral Subspace Clustering for Hyperspectral Image

Fusing Transformers in a Tuning Fork Structure for Hyperspectral Image Classification Across Disjoint Samples

Unsupervised Self-Correlated Learning Smoothy Enhanced Locality Preserving Graph Convolution Embedding Clustering for Hyperspectral Images

Fortifying Centers and Edges: Multidomain Feature Learning Meets Hyperspectral Image Classification

Adaptive Learnable Spectral–Spatial Fusion Transformer for Hyperspectral Image Classification

Dual Smooth Graph Convolutional Clustering for Large-Scale Hyperspectral Images

Hierarchical Spectral–Spatial Transformer for Hyperspectral and Multispectral Image Fusion

Superpixel-Based and Spatially Regularized Diffusion Learning for Unsupervised Hyperspectral Image Clustering

Dual-View Spectral and Global Spatial Feature Fusion Network for Hyperspectral Image Classification

A Hybrid Self-supervised Learning Framework For Hyperspectral Image Classification

CS2DT: Cross Spatial–Spectral Dense Transformer for Hyperspectral Image Classification

Hyperspectral Image Spectral–Spatial Classification Method Based on Deep Adaptive Feature Fusion

S3L: Spectrum Transformer for Self-Supervised Learning in Hyperspectral Image Classification

Deep clustering using 3D attention convolutional autoencoder for hyperspectral image analysis

Spectral-Spatial Attention Transformer with Dense Connection for Hyperspectral Image Classification

Two‐branch global spatial–spectral fusion transformer network for hyperspectral image classification

MHIAIFormer: Multihead Interacted and Adaptive Integrated Transformer With Spatial-Spectral Attention for Hyperspectral Image Classification

MHIAIFormer: Multi-Head Interacted and Adaptive Integrated Transformer with Spatial-Spectral Attention for Hyperspectral Image Classification

Superpixel-Level Global and Local Similarity Graph-Based Clustering for Large Hyperspectral Images