Abstract:Multisource remote sensing (RS) image classification is a significant research area in Earth observation, aiming to achieve more comprehensive and accurate classification of land cover by integrating data from different sensors. Due to differences in imaging mechanisms and information imbalance between multisource data, multisource RS image classification faces two major challenges as follows. 1) Synergistically capturing features from different modalities to fully exploit complementary information. 2) Adaptively fusing multisource features to overcome the imbalance between modalities and avoid redundant information. This article proposes a spectral–spatial feature extraction network with SSM–CNN (SSFNet) for the collaborative classification of hyperspectral images (HSI) and multispectral images (MSI). Specifically, SSFNet captures long-range spectral correlations in HSI through a bidirectional state–space model (SSM) and learns local correlations between adjacent channels through spectral grouping, achieving global–local spectral information mining in HSI. Simultaneously, joint spatial feature extraction for HSI and MSI data is performed using embedded weight-shared residual feature extractor based on convolutional neural network. This process involves adaptively identifying the importance of features through privatized factors in batch normalization and accurately replacing redundant features. In addition, a spatial attention module is used to further enhance spatial feature representation. Finally, to better accommodate feature distributions and enhance classification outcomes, the extracted spectral–spatial features are combined using weighted fusion, allowing for dynamic integration. Experimental results on two datasets demonstrate that the proposed SSFNet significantly outperforms other competing methods.

Hyperspectral Classification Based on Siamese Neural Network Using Spectral-Spatial Feature.

3D Convolutional Siamese Network for Few-Shot Hyperspectral Classification

A Hyperspectral Image Classification Method Based on the Nonlocal Attention Mechanism of a Multiscale Convolutional Neural Network.

A Multipath and Multiscale Siamese Network Based on Spatial-Spectral Features for Few-Shot Hyperspectral Image Classification

S3Net: Spectral–Spatial Siamese Network for Few-Shot Hyperspectral Image Classification

DEEP FEATURE EXTRACTION BASED ON SIAMESE NETWORK AND AUTO-ENCODER FOR HYPERSPECTRAL IMAGE CLASSIFICATION

Spectral-spatial classification of hyperspectral imagery using a dual-channel convolutional neural network

HSI-CNN: A Novel Convolution Neural Network for Hyperspectral Image

A Novel 2D-3D CNN with Spectral-Spatial Multi-Scale Feature Fusion for Hyperspectral Image Classification

Hyperspectral image classification method based on narrowing semantic gap convolutional neural network

Learning a Deep Similarity Network for Hyperspectral Image Classification

Hyper-S3NN: Spatial–spectral Spiking Neural Network for Hyperspectral Image Classification

SSCNN-S: A Spectral-Spatial Convolution Neural Network with Siamese Architecture for Change Detection

Hyperspectral Image Spectral–Spatial Classification Method Based on Deep Adaptive Feature Fusion

SPECTRAL-SPATIAL MULTISCALE RESIDUAL NETWORK FOR HYPERSPECTRAL IMAGE CLASSIFICATION

An Effective Hyperspectral Image Classification Network Based on Multi-Head Self-Attention and Spectral-Coordinate Attention

An End-to-End Hyperspectral Image Classification Method Using Deep Convolutional Neural Network with Spatial Constraint

Spectral–Spatial Feature Extraction Network With SSM–CNN for Hyperspectral–Multispectral Image Collaborative Classification

Adaptive Spectral-Spatial Feature Fusion Network for Hyperspectral Image Classification Using Limited Training Samples

Hybrid CNN Bi-LSTM neural network for Hyperspectral image classification

HybridSN: Exploring 3D-2D CNN Feature Hierarchy for Hyperspectral Image Classification