Abstract:Satellite image time series (SITS) data provides continuous observations over time, allowing for the tracking of vegetation changes and growth patterns throughout the seasons and years. Numerous deep learning (DL) approaches using SITS for crop classification have emerged recently, with the latest approaches adopting Transformer for SITS classification. However, the quadratic complexity of self-attention in Transformer poses challenges for classifying long time series. While the cutting-edge Mamba architecture has demonstrated strength in various domains, including remote sensing image interpretation, its capacity to learn temporal representations in SITS data remains unexplored. Moreover, the existing SITS classification methods often depend solely on crop labels as supervision signals, which fails to fully exploit the temporal information. In this paper, we proposed a Satellite Image Time Series Mamba (SITSMamba) method for crop classification based on remote sensing time series data. The proposed SITSMamba contains a spatial encoder based on Convolutional Neural Networks (CNN) and a Mamba-based temporal encoder. To exploit richer temporal information from SITS, we design two branches of decoder used for different tasks. The first branch is a crop Classification Branch (CBranch), which includes a ConvBlock to decode the feature to a crop map. The second branch is a SITS Reconstruction Branch that uses a Linear layer to transform the encoded feature to predict the original input values. Furthermore, we design a Positional Weight (PW) applied to the RBranch to help the model learn rich latent knowledge from SITS. We also design two weighting factors to control the balance of the two branches during training. The code of SITSMamba is available at: <a class="link-external link-https" href="https://github.com/XiaoleiQinn/SITSMamba" rel="external noopener nofollow">this https URL</a>.

SPPMamba: State Space Models for Seismic Phase Arrival Picking

RSMamba: Remote Sensing Image Classification with State Space Model

PPMamba: A Pyramid Pooling Local Auxiliary SSM-Based Model for Remote Sensing Image Semantic Segmentation

MambaAD: Exploring State Space Models for Multi-class Unsupervised Anomaly Detection

State-space models are accurate and efficient neural operators for dynamical systems

Spatial-Mamba: Effective Visual State Space Models via Structure-Aware State Fusion

Point Cloud Mamba: Point Cloud Learning via State Space Model

Mamba3D: Enhancing Local Features for 3D Point Cloud Analysis via State Space Model

PointMamba: A Simple State Space Model for Point Cloud Analysis

Samba: Semantic Segmentation of Remotely Sensed Images with State Space Model

SPMamba: State-space model is all you need in speech separation

PointABM:Integrating Bidirectional State Space Model with Multi-Head Self-Attention for Point Cloud Analysis

Bi-Mamba4TS: Bidirectional Mamba for Time Series Forecasting

State Space Models Meet Transformers for Hyperspectral Image Classification

RS3Mamba: Visual State Space Model for Remote Sensing Image Semantic Segmentation

SITSMamba for Crop Classification based on Satellite Image Time Series

A Lightweight Network for Seismic Phase Picking on Embedded Systems

MHS-VM: Multi-Head Scanning in Parallel Subspaces for Vision Mamba

U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentation

Speech-Mamba: Long-Context Speech Recognition with Selective State Spaces Models