Abstract:Multisource remote sensing (RS) image classification is a significant research area in Earth observation, aiming to achieve more comprehensive and accurate classification of land cover by integrating data from different sensors. Due to differences in imaging mechanisms and information imbalance between multisource data, multisource RS image classification faces two major challenges as follows. 1) Synergistically capturing features from different modalities to fully exploit complementary information. 2) Adaptively fusing multisource features to overcome the imbalance between modalities and avoid redundant information. This article proposes a spectral–spatial feature extraction network with SSM–CNN (SSFNet) for the collaborative classification of hyperspectral images (HSI) and multispectral images (MSI). Specifically, SSFNet captures long-range spectral correlations in HSI through a bidirectional state–space model (SSM) and learns local correlations between adjacent channels through spectral grouping, achieving global–local spectral information mining in HSI. Simultaneously, joint spatial feature extraction for HSI and MSI data is performed using embedded weight-shared residual feature extractor based on convolutional neural network. This process involves adaptively identifying the importance of features through privatized factors in batch normalization and accurately replacing redundant features. In addition, a spatial attention module is used to further enhance spatial feature representation. Finally, to better accommodate feature distributions and enhance classification outcomes, the extracted spectral–spatial features are combined using weighted fusion, allowing for dynamic integration. Experimental results on two datasets demonstrate that the proposed SSFNet significantly outperforms other competing methods.

Joint Multi-Mode Cooperative Classification Algorithm for Hyperspectral Images

Spectral-Spatial Classification of Hyperspectral Images Using Joint Bilateral Filter and Graph Cut Based Model.

Effects of calcium channel blockers on the contractile response to dihydroergotamine in isolated human femoral veins

Hyperspectral Image Classification Using Multi-Branch-multi-scale Residual Fusion Network

CMAAC: Combining Multiattention and Asymmetric Convolution Global Learning Framework for Hyperspectral Image Classification

Hyperspectral Image Classification Via Joint Sparse Representation of Multi-layer Superpixles.

A Joint Network of Edge-Aware and Spectral–Spatial Feature Learning for Hyperspectral Image Classification

Class-guided coupled dictionary learning for multispectral-hyperspectral remote sensing image collaborative classification

Superpixel-Based Multiple Statistical Feature Extraction Method for Classification of Hyperspectral Images

A Hybrid Self-supervised Learning Framework For Hyperspectral Image Classification

Multi-view learning for hyperspectral image classification: An overview

Semisupervised Hyperspectral Image Classification Based on Affinity Scoring.

MRF-Based Multiple Classifier System for Hyperspectral Remote Sensing Image Classification.

A 3-stage Spectral-spatial Method for Hyperspectral Image Classification

Multiscale Residual Weakly Dense Network with Attention Mechanism for Hyperspectral Image Classification

Hyperspectral image classification based on superpixel merging and broad learning system

Hyperspectral Image Classification via JCR and SVM Models With Decision Fusion

Spectral–Spatial Feature Extraction Network With SSM–CNN for Hyperspectral–Multispectral Image Collaborative Classification

MBSFC: hyperspectral image classification based on multi-branch and spectral feature conversion

Simultaneous Sparse Graph Embedding for Hyperspectral Image Classification

Hyperspectral Image Classification via Deep Network with Attention Mechanism and Multigroup Strategy