Abstract:Multisource remote sensing (RS) image classification is a significant research area in Earth observation, aiming to achieve more comprehensive and accurate classification of land cover by integrating data from different sensors. Due to differences in imaging mechanisms and information imbalance between multisource data, multisource RS image classification faces two major challenges as follows. 1) Synergistically capturing features from different modalities to fully exploit complementary information. 2) Adaptively fusing multisource features to overcome the imbalance between modalities and avoid redundant information. This article proposes a spectral–spatial feature extraction network with SSM–CNN (SSFNet) for the collaborative classification of hyperspectral images (HSI) and multispectral images (MSI). Specifically, SSFNet captures long-range spectral correlations in HSI through a bidirectional state–space model (SSM) and learns local correlations between adjacent channels through spectral grouping, achieving global–local spectral information mining in HSI. Simultaneously, joint spatial feature extraction for HSI and MSI data is performed using embedded weight-shared residual feature extractor based on convolutional neural network. This process involves adaptively identifying the importance of features through privatized factors in batch normalization and accurately replacing redundant features. In addition, a spatial attention module is used to further enhance spatial feature representation. Finally, to better accommodate feature distributions and enhance classification outcomes, the extracted spectral–spatial features are combined using weighted fusion, allowing for dynamic integration. Experimental results on two datasets demonstrate that the proposed SSFNet significantly outperforms other competing methods.

Spectral–Spatial Feature Extraction for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning Approach

Hyperspectral Image Spectral–Spatial Classification Method Based on Deep Adaptive Feature Fusion

Deep Spatial-Spectral Feature Extraction Network for Hyperspectral Image Classification

Deep Tensor Factorization for Hyperspectral Image Classification.

Spectral–spatial multi-feature-based deep learning for hyperspectral remote sensing image classification

Spectral–spatial Classification of Hyperspectral Images Using Deep Convolutional Neural Networks

Spectral-Spatial Discriminant Feature Learning For Hyperspectral Image Classification

SSC-SFN: spectral-spatial non-local segment federated network for hyperspectral image classification with limited labeled samples

A Fast Dense Spectral-Spatial Convolution Network Framework for Hyperspectral Images Classification

Exploiting Spectral–Spatial Information Using Deep Random Forest for Hyperspectral Imagery Classification

Simultaneous Spectral-Spatial Feature Selection and Extraction for Hyperspectral Images

Hyperspectral image spectral–spatial classification using local tensor discriminant feature extraction

Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks

Unleashing the full potential of hyperspectral imaging: Decoupled image and frequency-domain spatial–spectral framework

Spatial–Spectral Feature Extraction via Deep ConvLSTM Neural Networks for Hyperspectral Image Classification

DSSFN: A Dual-Stream Self-Attention Fusion Network for Effective Hyperspectral Image Classification

Spectral-spatial classification of hyperspectral imagery using a dual-channel convolutional neural network

Spectral–Spatial Feature Extraction Network With SSM–CNN for Hyperspectral–Multispectral Image Collaborative Classification

Hyperspectral Classification Based on Spectral-Spatial Convolutional Neural Networks

Hyperspectral Image Classification Based on Two-Branch Spectral–Spatial-Feature Attention Network

Fusion of Dual Spatial Information for Hyperspectral Image Classification