Abstract:As remote sensing imaging technology continues to advance and evolve, processing high-resolution and diversified satellite imagery to improve segmentation accuracy and enhance interpretation efficiency emerg as a pivotal area of investigation within the realm of remote sensing. Although segmentation algorithms based on CNNs and Transformers achieve significant progress in performance, balancing segmentation accuracy and computational complexity remains challenging, limiting their wide application in practical tasks. To address this, this paper introduces state space model (SSM) and proposes a novel hybrid semantic segmentation network based on vision Mamba (CVMH-UNet). This method designs a cross-scanning visual state space block (CVSSBlock) that uses cross 2D scanning (CS2D) to fully capture global information from multiple directions, while by incorporating convolutional neural network branches to overcome the constraints of Vision Mamba (VMamba) in acquiring local information, this approach facilitates a comprehensive analysis of both global and local features. Furthermore, to address the issue of limited discriminative power and the difficulty in achieving detailed fusion with direct skip connections, a multi-frequency multi-scale feature fusion block (MFMSBlock) is designed. This module introduces multi-frequency information through 2D discrete cosine transform (2D DCT) to enhance information utilization and provides additional scale local detail information through point-wise convolution branches. Finally, it aggregates multi-scale information along the channel dimension, achieving refined feature fusion. Findings from experiments conducted on renowned datasets of remote sensing imagery demonstrate that proposed CVMH-UNet achieves superior segmentation performance while maintaining low computational complexity, outperforming surpassing current leading-edge segmentation algorithms.

Interactive segmentation based on multiscale feature cascading

Adaptive fusion with multi-scale features for interactive image segmentation

Interactive Image Segmentation Via Cascaded Metric Learning

Multiscale Fusion Convolutional Network in Real-time Semantic Segmentation

Multielement Feature-Based Hierarchical Context Integration Network for Remote Sensing Image Segmentation

Cascaded Sparse Feature Propagation Network for Interactive Segmentation

ScaleNet: Rethinking Feature Interaction from a Scale-Wise Perspective for Medical Image Segmentation.

CIMFNet: Cross-layer Interaction and Multiscale Fusion Network for Semantic Segmentation of High-Resolution Remote Sensing Images

Cross-Scale Feature Propagation Network for Semantic Segmentation of High-Resolution Remote Sensing Images

Cascaded panoptic segmentation method for high resolution remote sensing image

MIGN: Multiscale Image Generation Network for Remote Sensing Image Semantic Segmentation

Remote Sensing Image Segmentation Using Vision Mamba and Multi-Scale Multi-Frequency Feature Fusion

Multilateral Cascading Network for Semantic Segmentation of Large-Scale Outdoor Point Clouds

MCFNet: Multi-scale Covariance Feature Fusion Network for Real-time Semantic Segmentation

MSDEnet: Multi-scale detail enhanced network based on human visual system for medical image segmentation

Research on Attention-Based Multiscale Information Fusion with the Real-Time Instance Segmentation Method

Interactive Segmentation Based on Super-Pixel and Multi-Cues Combination

Aggregating Multi-Scale Contextual Features from Multiple Stages for Semantic Image Segmentation

Multi-perspective feature compensation enhanced network for medical image segmentation

MFCP-Net: Multiscale Feature Correlation Perception Network for Image Segmentation Based on Background Prior

MSSINet: Real-Time Segmentation Based on Multi-Scale Strip Integration