Abstract:Land cover analysis using hyperspectral images (HSI) remains an open problem due to their low spatial resolution and complex spectral information. Recent studies are primarily dedicated to designing Transformer-based architectures for spatial-spectral long-range dependencies modeling, which is computationally expensive with quadratic complexity. Selective structured state space model (Mamba), which is efficient for modeling long-range dependencies with linear complexity, has recently shown promising progress. However, its potential in hyperspectral image processing that requires handling numerous spectral bands has not yet been explored. In this paper, we innovatively propose S$^2$Mamba, a spatial-spectral state space model for hyperspectral image classification, to excavate spatial-spectral contextual features, resulting in more efficient and accurate land cover analysis. In S$^2$Mamba, two selective structured state space models through different dimensions are designed for feature extraction, one for spatial, and the other for spectral, along with a spatial-spectral mixture gate for optimal fusion. More specifically, S$^2$Mamba first captures spatial contextual relations by interacting each pixel with its adjacent through a Patch Cross Scanning module and then explores semantic information from continuous spectral bands through a Bi-directional Spectral Scanning module. Considering the distinct expertise of the two attributes in homogenous and complicated texture scenes, we realize the Spatial-spectral Mixture Gate by a group of learnable matrices, allowing for the adaptive incorporation of representations learned across different dimensions. Extensive experiments conducted on HSI classification benchmarks demonstrate the superiority and prospect of S$^2$Mamba. The code will be made available at: <a class="link-external link-https" href="https://github.com/PURE-melo/S2Mamba" rel="external noopener nofollow">this https URL</a>.

SSUMamba: Spatial-Spectral Selective State Space Model for Hyperspectral Image Denoising

SSUMamba: Spatial-Spectral Selective State Space Model for Hyperspectral Image Denoising

HSIDMamba: Exploring Bidirectional State-Space Models for Hyperspectral Denoising

Multitask Sparse Nonnegative Matrix Factorization for Joint Spectral–Spatial Hyperspectral Imagery Denoising

Nonlocal Spatial–Spectral Neural Network for Hyperspectral Image Denoising

Multitask Sparse Representation Model-Inspired Network for Hyperspectral Image Denoising

S^2Mamba: A Spatial-spectral State Space Model for Hyperspectral Image Classification

S$^2$Mamba: A Spatial-spectral State Space Model for Hyperspectral Image Classification

Learning a Model-Based Deep Hyperspectral Denoiser from a Single Noisy Hyperspectral Image.

3DSS-Mamba: 3D-Spectral-Spatial Mamba for Hyperspectral Image Classification

SpectralMamba: Efficient Mamba for Hyperspectral Image Classification

Spatial-spectral convolutional sparse neural network for hyperspectral image denoising

A hyperspectral image denoising method based on land cover spectral autocorrelation

Deep Parameterized Neural Networks for Hyperspectral Image Denoising

Dual Hyperspectral Mamba for Efficient Spectral Compressive Imaging

Mamba-in-Mamba: Centralized Mamba-Cross-Scan in Tokenized Mamba Model for Hyperspectral Image Classification

HDMba: Hyperspectral Remote Sensing Imagery Dehazing with State Space Model

Multi-head Spatial-Spectral Mamba for Hyperspectral Image Classification

Hybrid Spatial-spectral Neural Network for Hyperspectral Image Denoising

IGroupSS-Mamba: Interval Group Spatial-Spectral Mamba for Hyperspectral Image Classification

Spectral-Spatial Mamba for Hyperspectral Image Classification