Abstract:As remote sensing imaging technology continues to advance and evolve, processing high-resolution and diversified satellite imagery to improve segmentation accuracy and enhance interpretation efficiency emerg as a pivotal area of investigation within the realm of remote sensing. Although segmentation algorithms based on CNNs and Transformers achieve significant progress in performance, balancing segmentation accuracy and computational complexity remains challenging, limiting their wide application in practical tasks. To address this, this paper introduces state space model (SSM) and proposes a novel hybrid semantic segmentation network based on vision Mamba (CVMH-UNet). This method designs a cross-scanning visual state space block (CVSSBlock) that uses cross 2D scanning (CS2D) to fully capture global information from multiple directions, while by incorporating convolutional neural network branches to overcome the constraints of Vision Mamba (VMamba) in acquiring local information, this approach facilitates a comprehensive analysis of both global and local features. Furthermore, to address the issue of limited discriminative power and the difficulty in achieving detailed fusion with direct skip connections, a multi-frequency multi-scale feature fusion block (MFMSBlock) is designed. This module introduces multi-frequency information through 2D discrete cosine transform (2D DCT) to enhance information utilization and provides additional scale local detail information through point-wise convolution branches. Finally, it aggregates multi-scale information along the channel dimension, achieving refined feature fusion. Findings from experiments conducted on renowned datasets of remote sensing imagery demonstrate that proposed CVMH-UNet achieves superior segmentation performance while maintaining low computational complexity, outperforming surpassing current leading-edge segmentation algorithms.

Ultra-High Resolution Image Segmentation with Efficient Multi-Scale Collective Fusion

Patch-Free 3D Medical Image Segmentation Driven by Super-Resolution Technique and Self-Supervised Guidance

Super-Resolution Based Patch-Free 3D Medical Image Segmentation with Self-Supervised Guidance

An Image Segmentation Method Based on Transformer and Multi-Scale Feature Fusion for UAV Marine Environment Monitoring

ISDNet: Integrating Shallow and Deep Networks for Efficient Ultra-high Resolution Segmentation

Multi-Field Context Fusion Network for Semantic Segmentation of High-Spatial-Resolution Remote Sensing Images

Memory-Constrained Semantic Segmentation for Ultra-High Resolution UAV Imagery

Enhanced Multi-Scale Feature Adaptive Fusion Sparse Convolutional Network for Large-Scale Scenes Semantic Segmentation

A Multi-Step Fusion Network for Semantic Segmentation of High-Resolution Aerial Images

Super-Resolution Based Patch-Free 3D Image Segmentation with High-Frequency Guidance

Remote Sensing Image Segmentation Using Vision Mamba and Multi-Scale Multi-Frequency Feature Fusion

An RGB-D Fusion Based Semantic Segmentation Algorithm Based on Neighborhood Metric Relations

Multiscale Fusion Convolutional Network in Real-time Semantic Segmentation

High Quality Segmentation for Ultra High-resolution Images

MSCFNet: A Lightweight Network with Multi-Scale Context Fusion for Real-Time Semantic Segmentation

Fast Semantic Segmentation of Remote Sensing Images Using a Network That Integrates Global and Local Information

Revisiting Multi-Scale Feature Fusion for Semantic Segmentation

Real-Time Semantic Segmentation via Multiply Spatial Fusion Network

Research on Attention-Based Multiscale Information Fusion with the Real-Time Instance Segmentation Method

When Humans Meet Machines: Towards Efficient Segmentation Networks.

Semantic Segmentation of Remote-Sensing Images Based on Multiscale Feature Fusion and Attention Refinement