Abstract:Hyperspectral image (HSI) classification is an important topic in remote sensing tasks, aiming to exploit the spectral and spatial information in HSI to assign category labels to each pixel. Recently, numerous deep learning (DL) methods, such as convolutional neural network (CNN) and transformer, have been introduced and achieved promising results. These DL-based models tend to use patch-based input patterns, where a patch is extracted around a central pixel and the neighboring pixels serve as auxiliary roles. However, compared to developing novel models, the characteristics of the patch-based HSI classification framework have not been adequately explored. Most existing patch-based DL methods tend to overlook the potential relationships between the central pixel and its neighboring pixels. In addition, the unique spectral characteristics of HSI (e.g., adjacent bands possess higher correlation) require special attention. Moreover, the design of feature extractors for HSIs appears to be constrained primarily to the spatial and spectral domains. To cope with the above problems, we propose an HSI classification specifically designed model (HSIC-SDM), which encompasses three branches—frequency feature learning, spatial feature learning, and spectral feature learning. The frequency feature learning branch employs a Fourier-based feature extractor to acquire representations in the frequency domain. The spatial feature learning branch emphasizes the significance of central pixel and edge information. The spectral feature learning branch concerns the high correlations in the adjacent spectral bands. Multidomain features derived from three branches provide diverse perspectives for the final classification. Extensive experiments on three datasets demonstrate the superiority of the proposed method over the state-of-the-art (SOTA) compared methods. The code of our work will be available publicly at https://github.com/Tikiten/HSIC-SDM.

Feature Extraction Via 3-D Block Characteristics Sharing for Hyperspectral Image Classification

Hyperspectral Image Super-Resolution Classification With A Small Training Set Using Spectral Variation Extended Endmember Library

Residual Deep PCA-based Feature Extraction for Hyperspectral Image Classification

Feature Extraction Using Multidimensional Spectral Regression Whitening for Hyperspectral Image Classification

Spectral-spatial hyperspectral image classification via SVM and superpixel segmentation

Robust Spatial–Spectral Block-Diagonal Structure Representation with Fuzzy Class Probability for Hyperspectral Image Classification

Spectral–Spatial Gabor Surface Feature Fusion Approach for Hyperspectral Imagery Classification

[Hyperspectral image classification based on 3-D gabor filter and support vector machines]

Local Binary Pattern-Based Hyperspectral Image Classification with Superpixel Guidance.

Multiple 3-D Feature Fusion Framework for Hyperspectral Image Classification

Hyperspectral image classification based on superpixel merging and broad learning system

Integration of 3-dimensional discrete wavelet transform and Markov random field for hyperspectral image classification.

A Joint Network of Edge-Aware and Spectral–Spatial Feature Learning for Hyperspectral Image Classification

Multiscale Feature Extraction Based on Convolutional Sparse Decomposition for Hyperspectral Image Classification

Superpixel-Based Multiple Statistical Feature Extraction Method for Classification of Hyperspectral Images

Fortifying Centers and Edges: Multidomain Feature Learning Meets Hyperspectral Image Classification

Contour Structural Profiles: An Edge-Aware Feature Extractor for Hyperspectral Image Classification

Multiscale Deep Spatial Feature Extraction Using Virtual RGB Image for Hyperspectral Imagery Classification

Spectral–Spatial and Superpixelwise PCA for Unsupervised Feature Extraction of Hyperspectral Imagery

A 3-stage Spectral-spatial Method for Hyperspectral Image Classification

Spatial Feature Enhancement and Attention-Guided Bidirectional Sequential Spectral Feature Extraction for Hyperspectral Image Classification