Abstract:Semantic segmentation is crucial for a wide range of downstream applications in remote sensing, aiming to classify pixels in remote sensing images (RSIs) at the semantic level. The dramatic variations in grayscale and the stacking of categories within RSIs lead to unstable inter-class variance and exacerbate the uncertainty around category boundaries. However, existing methods typically emphasize spatial information while overlooking frequency insights, making it difficult to achieve desirable results. To address these challenges, we propose a novel dual-domain fusion network that integrates both spatial and frequency features. For grayscale variations, a multi-level wavelet frequency decomposition module (MWFD) is introduced to extract and integrate multi-level frequency features to enhance the distinctiveness between spatially similar categories. To mitigate the uncertainty of boundaries, a type-2 fuzzy spatial constraint module (T2FSC) is proposed to achieve flexible higher-order fuzzy modeling to adaptively constrain the boundary features in the spatial by constructing upper and lower membership functions. Furthermore, a dual-domain feature fusion (DFF) module bridges the semantic gap between the frequency and spatial features, effectively realizes semantic alignment and feature fusion between the dual domains, which further improves the accuracy of segmentation results. We conduct comprehensive experiments and extensive ablation studies on three well-known datasets: Vaihingen, Potsdam, and GID. In these three datasets, our method achieved 74.56%, 73.60%, and 81.01% mIoU, respectively. Quantitative and qualitative results demonstrate that the proposed method significantly outperforms state-of-the-art methods, achieving an excellent balance between segmentation accuracy and computational overhead.

Dual Fusion Network for Hyperspectral Semantic Segmentation.

Hyperspectral and Multispectral Image Fusion Based on Deep Attention Network.

NLFNet: Non-Local Fusion Towards Generalized Multimodal Semantic Segmentation Across RGB-Depth, Polarization, and Thermal Images

Multispectral Fusion Transformer Network for RGB-Thermal Urban Scene Semantic Segmentation

An RGB-D Fusion Based Semantic Segmentation Algorithm Based on Neighborhood Metric Relations

Dual-Path Multi-Level Feature Fusion Network for Semantic Segmentation of Remote Sensing Image

A Fusion Network for Semantic Segmentation Using RGB-D Data

Dual-Path Feature Fusion Network for Semantic Segmentation of Remote Sensing Images

CCAFFMNet: Dual-spectral semantic segmentation network with channel-coordinate attention feature fusion module

Hyperspectral Image Fusion Based on Dual-Resolution Fusion Feature Mutual Guidance Network

Residual Spatial Fusion Network for RGB-Thermal Semantic Segmentation

Dual Attention Based Multi-scale Feature Fusion Network for Indoor RGBD Semantic Segmentation.

The Network of Attention-Aware Multimodal Fusion for RGB-D Indoor Semantic Segmentation Method

Dual-Domain Fusion Network Based on Wavelet Frequency Decomposition and Fuzzy Spatial Constraint for Remote Sensing Image Segmentation

Bimodal Feature Propagation and Fusion for Real-time Semantic Segmentation on RGB-D Images

Feature Fusion Network Model Based on Dual Attention Mechanism for Hyperspectral Image Classification

Incorporating Luminance, Depth and Color Information by a Fusion-based Network for Semantic Segmentation

Dual-View Spectral and Global Spatial Feature Fusion Network for Hyperspectral Image Classification

Multi-type and Multi-level Feature Fusion Network for RGBD Indoor Semantic Segmentation

Multimodal Frequeny Spectrum Fusion Schema for RGB-T Image Semantic Segmentation

BUSIFusion: Blind Unsupervised Single Image Fusion of Hyperspectral and RGB Images