Abstract:Semantic segmentation is crucial for a wide range of downstream applications in remote sensing, aiming to classify pixels in remote sensing images (RSIs) at the semantic level. The dramatic variations in grayscale and the stacking of categories within RSIs lead to unstable inter-class variance and exacerbate the uncertainty around category boundaries. However, existing methods typically emphasize spatial information while overlooking frequency insights, making it difficult to achieve desirable results. To address these challenges, we propose a novel dual-domain fusion network that integrates both spatial and frequency features. For grayscale variations, a multi-level wavelet frequency decomposition module (MWFD) is introduced to extract and integrate multi-level frequency features to enhance the distinctiveness between spatially similar categories. To mitigate the uncertainty of boundaries, a type-2 fuzzy spatial constraint module (T2FSC) is proposed to achieve flexible higher-order fuzzy modeling to adaptively constrain the boundary features in the spatial by constructing upper and lower membership functions. Furthermore, a dual-domain feature fusion (DFF) module bridges the semantic gap between the frequency and spatial features, effectively realizes semantic alignment and feature fusion between the dual domains, which further improves the accuracy of segmentation results. We conduct comprehensive experiments and extensive ablation studies on three well-known datasets: Vaihingen, Potsdam, and GID. In these three datasets, our method achieved 74.56%, 73.60%, and 81.01% mIoU, respectively. Quantitative and qualitative results demonstrate that the proposed method significantly outperforms state-of-the-art methods, achieving an excellent balance between segmentation accuracy and computational overhead.

Multi-feature Fusion for Image Segmentation Based on Granular Theory.

Multi-value Image Segmentation Based on FCM Algorithm and Graph Cut Theory.

Two-stage Fine-Grained Image Classification Model Based on Multi-Granularity Feature Fusion

Hierarchical Image Segmentation Based on Multi-feature Fusion and Graph Cut Optimization.

A Novel Image Segmentation Algorithm Based on Multiple Features Fusion with Hypergraph and Superpixel

RGB-D image segmentation using superpixel and multi-feature fusion graph theory

Affinity Fusion Graph-Based Framework for Natural Image Segmentation

Multiobjective multiple features fusion: A case study in image segmentation

Multi-features Fusion Based CRFs for Face Segmentation.

Image Retrieval Using Multi-Granularity Color Features

FGCN: Image-Fused Point Cloud Semantic Segmentation with Fusion Graph Convolutional Network

Multi-task Low-Rank Affinity Pursuit for Image Segmentation.

FusionGCN: Multi-focus image fusion using superpixel features generation GCN and pixel-level feature reconstruction CNN

Video Segmentation via Multiple Granularity Analysis

A preliminary study using granular computing for remote sensing image segmentation involving roughness

Application of Multi-granularity Color Features in Image Retrieval

Multi-Focus Image Fusion Based on Multi-Scale Gradients and Image Matting

Dual-Domain Fusion Network Based on Wavelet Frequency Decomposition and Fuzzy Spatial Constraint for Remote Sensing Image Segmentation

Image Segmentation Based on Fussing Multi-feature and Spatial Spectral Clustering

An image segmentation fusion algorithm based on density peak clustering and Markov random field

SCGRFuse: An infrared and visible image fusion network based on spatial/channel attention mechanism and gradient aggregation residual dense blocks