Abstract:Hyperspectral image (HSI) classification is an important topic in remote sensing tasks, aiming to exploit the spectral and spatial information in HSI to assign category labels to each pixel. Recently, numerous deep learning (DL) methods, such as convolutional neural network (CNN) and transformer, have been introduced and achieved promising results. These DL-based models tend to use patch-based input patterns, where a patch is extracted around a central pixel and the neighboring pixels serve as auxiliary roles. However, compared to developing novel models, the characteristics of the patch-based HSI classification framework have not been adequately explored. Most existing patch-based DL methods tend to overlook the potential relationships between the central pixel and its neighboring pixels. In addition, the unique spectral characteristics of HSI (e.g., adjacent bands possess higher correlation) require special attention. Moreover, the design of feature extractors for HSIs appears to be constrained primarily to the spatial and spectral domains. To cope with the above problems, we propose an HSI classification specifically designed model (HSIC-SDM), which encompasses three branches—frequency feature learning, spatial feature learning, and spectral feature learning. The frequency feature learning branch employs a Fourier-based feature extractor to acquire representations in the frequency domain. The spatial feature learning branch emphasizes the significance of central pixel and edge information. The spectral feature learning branch concerns the high correlations in the adjacent spectral bands. Multidomain features derived from three branches provide diverse perspectives for the final classification. Extensive experiments on three datasets demonstrate the superiority of the proposed method over the state-of-the-art (SOTA) compared methods. The code of our work will be available publicly at https://github.com/Tikiten/HSIC-SDM.

Classification of Hyperspectral Image Based on Principal Component Analysis and Deep Learning

Residual Deep PCA-based Feature Extraction for Hyperspectral Image Classification

Spectral-Spatial Classification of Hyperspectral Image Using Improved Functional Principal Component Analysis

Efficient Deep Belief Network Based Hyperspectral Image Classification

Deep Learning-Based Classification of Hyperspectral Data

Deep Learning for Hyperspectral Image Classification: An Overview

Classification of hyperspectral image based on deep belief networks

Spectral–spatial multi-feature-based deep learning for hyperspectral remote sensing image classification

Classification Based On Deep Convolutional Neural Networks With Hyperspectral Image

Hyperspectral image classification via shape-adaptive deep learning

Multiple Deep-Belief-network-based Spectral-Spatial Classification of Hyperspectral Images

Analysis of Hyperspectral Image Classification Technology and Application Based on Convolutional Neural Networks

Deep Manifold Reconstruction Neural Network for Hyperspectral Image Classification

A combination method of stacked autoencoder and 3D deep residual network for hyperspectral image classification

Deep Convolutional Neural Networks for Hyperspectral Image Classification

A Multi-Label Hyperspectral Image Classification Method with Deep Learning Features.

Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks

Wide and Deep Fourier Neural Network for Hyperspectral Remote Sensing Image Classification

Classification of Hyperspectral Image Based on Double-Branch Dual-Attention Mechanism Network

Fortifying Centers and Edges: Multidomain Feature Learning Meets Hyperspectral Image Classification

Spectral–spatial Classification of Hyperspectral Images Using Deep Convolutional Neural Networks