Abstract:The extraction of buildings from synthetic aperture radar (SAR) images poses a challenging task in the realm of remote sensing (RS). In recent years, convolutional neural networks (CNNs) have rapidly advanced and found application in the field of RS. Researchers have investigated the potential of CNNs for the semantic segmentation of SAR images, bringing excellent improvements. However, the semantic segmentation of buildings in SAR images still encounters challenges due to the high similarity between features of ground objects and buildings in SAR images, as well as the variability in building structures. In this article, we propose the local–global multiscale fusion network (LGMFNet), based on a dual encoder–decoder structure, for the semantic segmentation of buildings in SAR images. The proposed LGMFNet introduces an auxiliary encoder with a transformer structure to address the limitation of using the main encoder with a CNN structure for global modeling. To embed global dependencies hierarchically into the CNN, we designed the global–local semantic aggregation module (GLSM). The GLSM serves as a bridge between the dual encoders to achieve semantic guidance and coupling from the local to the global level. Furthermore, to bridge the semantic gap between different scales, we designed the multiscale feature fusion network (MSFN) as the decoder. MSFN achieves the interactive fusion of semantic information between various scales by constructing the multiscale feature fusion module. Experimental results demonstrate that the proposed LGMFNet achieves the mIoU of 91.17% on the BIGSARDATA 2023 AISAR competition dataset, outperforming the second-best method by a margin of 0.78%. This evidences the superiority of LGMFNet in comparison to other state-of-the-art methods.

Multi-scale Spatial Context-Based Semantic Edge Detection

Deep Dual-Stream Network with Scale Context Selection Attention Module for Semantic Segmentation

All-Higher-Stages-In Adaptive Context Aggregation for Semantic Edge Detection

Enhanced Multi-Scale Feature Adaptive Fusion Sparse Convolutional Network for Large-Scale Scenes Semantic Segmentation

MCFNet: Multi-scale Covariance Feature Fusion Network for Real-time Semantic Segmentation

MSCFNet: A Lightweight Network with Multi-Scale Context Fusion for Real-Time Semantic Segmentation

Edge-Enhanced GCIFFNet: A Multiclass Semantic Segmentation Network Based on Edge Enhancement and Multiscale Attention Mechanism

PointMS: Semantic Segmentation for Point Cloud Based on Multi-scale Directional Convolution

MFEAFN: Multi-scale feature enhanced adaptive fusion network for image semantic segmentation

Multi-scale coupled attention for visual object detection

Multiscale Fusion Convolutional Network in Real-time Semantic Segmentation

A Saliency Enhanced Feature Fusion based multiscale RGB-D Salient Object Detection Network

Dynamic Feature Fusion for Semantic Edge Detection

MFCINet: multi-level feature and context information fusion network for RGB-D salient object detection

Multilevel Context Feature Fusion for Semantic Segmentation of ALS Point Cloud

Edge Detection Guide Network for Semantic Segmentation of Remote-Sensing Images

Exploring multi-scale deformable context and channel-wise attention for salient object detection

BDCN: Bi-Directional Cascade Network for Perceptual Edge Detection

CASENet: Deep Category-Aware Semantic Edge Detection

Local–Global Multiscale Fusion Network for Semantic Segmentation of Buildings in SAR Imagery

Msmsfnet: a multi-stream and multi-scale fusion net for edge detection