Abstract:Hyperspectral image (HSI) classification is an important topic in remote sensing tasks, aiming to exploit the spectral and spatial information in HSI to assign category labels to each pixel. Recently, numerous deep learning (DL) methods, such as convolutional neural network (CNN) and transformer, have been introduced and achieved promising results. These DL-based models tend to use patch-based input patterns, where a patch is extracted around a central pixel and the neighboring pixels serve as auxiliary roles. However, compared to developing novel models, the characteristics of the patch-based HSI classification framework have not been adequately explored. Most existing patch-based DL methods tend to overlook the potential relationships between the central pixel and its neighboring pixels. In addition, the unique spectral characteristics of HSI (e.g., adjacent bands possess higher correlation) require special attention. Moreover, the design of feature extractors for HSIs appears to be constrained primarily to the spatial and spectral domains. To cope with the above problems, we propose an HSI classification specifically designed model (HSIC-SDM), which encompasses three branches—frequency feature learning, spatial feature learning, and spectral feature learning. The frequency feature learning branch employs a Fourier-based feature extractor to acquire representations in the frequency domain. The spatial feature learning branch emphasizes the significance of central pixel and edge information. The spectral feature learning branch concerns the high correlations in the adjacent spectral bands. Multidomain features derived from three branches provide diverse perspectives for the final classification. Extensive experiments on three datasets demonstrate the superiority of the proposed method over the state-of-the-art (SOTA) compared methods. The code of our work will be available publicly at https://github.com/Tikiten/HSIC-SDM.

A Universal Representation Mechanism for Multi-Source Hyperspectral Remote Sensing Image

Hyperspectral Image Super-Resolution with 1D-2D Attentional Convolutional Neural Network.

Remote Sensing Hyperspectral Image Super-Resolution via Multidomain Spatial Information and Multiscale Spectral Information Fusion

Robust Multi-View Representation for Spatial-Spectral Domain in Application of Hyperspectral Image Classification.

Hyperspectral Remote Sensing Image Synthesis Based on Implicit Neural Spectral Mixing Models

Multi-Scale Superpixels Dimension Reduction Hyperspectral Image Classification Algorithm Based on Low Rank Sparse Representation Joint Hierarchical Recursive Filtering

Hyperspectral Image Analysis in Single-Modal and Multimodal setting using Deep Learning Techniques

Hyperspectral Compressive Snapshot Reconstruction via Coupled Low-Rank Subspace Representation and Self-Supervised Deep Network

A Hybrid Neural Network for Hyperspectral Image Classification

Adaptive Nonnegative Sparse Representation for Hyperspectral Image Super-Resolution

Learning Discriminative Compact Representation for Hyperspectral Imagery Classification

Wide and Deep Fourier Neural Network for Hyperspectral Remote Sensing Image Classification

Sparse Coding with Morphology Segmentation and Multi-Label Fusion for Hyperspectral Image Super-Resolution

3-D Channel and Spatial Attention Based Multiscale Spatial-Spectral Residual Network for Hyperspectral Image Classification

Fortifying Centers and Edges: Multidomain Feature Learning Meets Hyperspectral Image Classification

HSIGene: A Foundation Model For Hyperspectral Image Generation

Implicit Neural Representation Learning for Hyperspectral Image Super-Resolution

Multiobjective-Based Sparse Representation Classifier for Hyperspectral Imagery Using Limited Samples

Hyperspectral Image Super-Resolution via Deep Spatiospectral Attention Convolutional Neural Networks

Multiscale Feature-Learning with a Unified Model for Hyperspectral Image Classification

Multiscale Residual Weakly Dense Network with Attention Mechanism for Hyperspectral Image Classification