Abstract:Hyperspectral image (HSI) classification is an important topic in remote sensing tasks, aiming to exploit the spectral and spatial information in HSI to assign category labels to each pixel. Recently, numerous deep learning (DL) methods, such as convolutional neural network (CNN) and transformer, have been introduced and achieved promising results. These DL-based models tend to use patch-based input patterns, where a patch is extracted around a central pixel and the neighboring pixels serve as auxiliary roles. However, compared to developing novel models, the characteristics of the patch-based HSI classification framework have not been adequately explored. Most existing patch-based DL methods tend to overlook the potential relationships between the central pixel and its neighboring pixels. In addition, the unique spectral characteristics of HSI (e.g., adjacent bands possess higher correlation) require special attention. Moreover, the design of feature extractors for HSIs appears to be constrained primarily to the spatial and spectral domains. To cope with the above problems, we propose an HSI classification specifically designed model (HSIC-SDM), which encompasses three branches—frequency feature learning, spatial feature learning, and spectral feature learning. The frequency feature learning branch employs a Fourier-based feature extractor to acquire representations in the frequency domain. The spatial feature learning branch emphasizes the significance of central pixel and edge information. The spectral feature learning branch concerns the high correlations in the adjacent spectral bands. Multidomain features derived from three branches provide diverse perspectives for the final classification. Extensive experiments on three datasets demonstrate the superiority of the proposed method over the state-of-the-art (SOTA) compared methods. The code of our work will be available publicly at https://github.com/Tikiten/HSIC-SDM.

Hyperspherical Structural-aware Distillation Enhanced Spatial-Spectral Bidirectional Interaction Network for Hyperspectral Image Classification

Hyperspectral Image Classification Using Hierarchical Spatial-Spectral Transformer

Decoupled Knowledge Distillation Via Spatial Feature Blurring for Hyperspectral Image Classification

A Cross-Channel Dense Connection and Multi-Scale Dual Aggregated Attention Network for Hyperspectral Image Classification

Hybrid Spectral-Spatial Convolutional Network and Transformer with Mixup Regularization for Hyperspectral Image Classification

Efficient Spectral Pyramid and Spectral-Spatial Feature Interactive Hyperspectral Image Classification.

Dual-View Spectral and Global Spatial Feature Fusion Network for Hyperspectral Image Classification

Hyperspectral Image Classification Method Based on 2d–3d CNN and Multibranch Feature Fusion

Cooperative Spectral–Spatial Attention Dense Network for Hyperspectral Image Classification

HyperspectraI Image Classification with Diverse Region Multiscale Feature Extraction and Spectral Imaging

Fortifying Centers and Edges: Multidomain Feature Learning Meets Hyperspectral Image Classification

A Dual-Branch Network Based on Transformer and Depthwise Convolution for Hyperspectral Image Classification

A Novel 2D-3D CNN with Spectral-Spatial Multi-Scale Feature Fusion for Hyperspectral Image Classification

Grouped Bidirectional LSTM Network and Multi-Stage Fusion Convolutional Transformer for Hyperspectral Image Classification

<i>H<SUP>2</SUP>A<SUP>2</SUP></i>Net: A Hybrid Convolution and Hybrid Resolution Network with Double Attention for Hyperspectral Image Classification

Deep Fully Convolutional Network-Based Spatial Distribution Prediction for Hyperspectral Image Classification.

Hyperspectral Image Classification Based on Multiscale Spatial and Spectral Feature Network.

Dual Heterogeneous Network for Hyperspectral Image Classification

Hyperspectral Image Classification Based on Two-Branch Spectral–Spatial-Feature Attention Network

Bidirectional-Convolutional LSTM Based Spectral-Spatial Feature Learning for Hyperspectral Image Classification

Beyond the Patchwise Classification: Spectral-Spatial Fully Convolutional Networks for Hyperspectral Image Classification