Abstract:Traditional convolutional neural networks (CNNs) and transformer models have limitations when dealing with long sequences. To address this issue, we introduced the Mamba framework from the State Space Model (SSM). Preserve image details through convolutional blocks while utilizing bidirectional attention decoding. Finally, we proposed a lightweight medical segmentation model that demonstrated competitiveness on six common datasets. Presently, State Space Models (SSMs), including frameworks like Mamba, have been incorporated into the realm of computer vision. These models not only sustain remote interactions and encapsulate global semantic information effectively, but also preserve linear computational complexity, offering a balance between performance and computational efficiency. Given that Mamba inherently adheres to the principle of selectivity when constructing sequence models, the goal is to further unleash the potential of Mamba through this innovative combination of convolution and self‐attention, improve accuracy and minimize the number of parameters while achieving linear complexity. Mamba is employed as an encoder to distill semantic information from the image, and it is supplemented with convolutional blocks, thereby conserving the details of the image. Concurrently, embedding prompts at a deeper level enhances its adaptability to cater to diverse requirements. Lastly, a bidirectional attention mechanism is incorporated for inference, striving to retain both global connections and local details to the maximum extent. This culminates in a novel, lightweight medical segmentation model. Exhaustive experiments were executed on six public datasets. The empirical results show that the proposed model exhibits competitive performance in medical image segmentation tasks.

SR-Mamba: Effective Surgical Phase Recognition with State Space Model

SPRMamba: Surgical Phase Recognition for Endoscopic Submucosal Dissection with Mamba

SEDMamba: Enhancing Selective State Space Modelling with Bottleneck Mechanism and Fine-to-Coarse Temporal Fusion for Efficient Error Detection in Robot-Assisted Surgery

Not End-to-End: Explore Multi-Stage Architecture for Online Surgical Phase Recognition

Spatial-Mamba: Effective Visual State Space Models via Structure-Aware State Fusion

SegMamba: Long-range Sequential Modeling Mamba For 3D Medical Image Segmentation

Surgical Temporal Action-aware Network with Sequence Regularization for Phase Recognition

SPHASE: Multi-Modal and Multi-Branch Surgical Phase Segmentation Framework based on Temporal Convolutional Network.

Neural Finite-State Machines for Surgical Phase Recognition

A Novel Deep ML Architecture by Integrating Visual Simultaneous Localization and Mapping (vSLAM) into Mask R-CNN for Real-time Surgical Video Analysis

Attention-based Spatial-Temporal Neural Network for Accurate Phase Recognition in Minimally Invasive Surgery: Feasibility and Efficiency Verification

SpikMamba: When SNN meets Mamba in Event-based Human Action Recognition

Manta: Enhancing Mamba for Few-Shot Action Recognition of Long Sub-Sequence

Hi-Mamba: Hierarchical Mamba for Efficient Image Super-Resolution

Think Step by Step: Chain-of-Gesture Prompting for Error Detection in Robotic Surgical Videos

MHS-VM: Multi-Head Scanning in Parallel Subspaces for Vision Mamba

LPAM: A lightweight medical segmentation network based on Mamba improved by prompt attention

ST-MTL: Spatio-Temporal multitask learning model to predict scanpath while tracking instruments in robotic surgery

Simba: Mamba augmented U-ShiftGCN for Skeletal Action Recognition in Videos

An Empirical Study on Activity Recognition in Long Surgical Videos

U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentation