Abstract:Global contextual information is crucial for the semantic segmentation of remote sensing (RS) images. However, the majority of current approaches depend on convolutional neural networks (CNNs). Due to the local receptive fields inherent in convolutional operations, these networks typically capture image features within limited areas and struggle to comprehend broader contextual information in the images. In this study, a dual-branch encoding approach, DESformer, is proposed, integrating transformers with CNN, to effectively capture global multiscale context information and enhance edge feature extraction. In addition, DESformer incorporates a feature interaction module (FIM) to combine local features with global representations extracted by transformers and CNN, respectively, across different resolutions. This approach enhances the capability to capture local features in RS images and improves the understanding of extensive spatial relationships. Subsequently, we employ a novel top-down approach for global supervision of the traditional feature pyramid multilevel visual integration (MVI) module, by harnessing the clear visual center information obtained from the deepest internal features. To successfully concentrate on important information and preserve sensitivity to features at various scales, the preceding shallow features are muted. In addition, FIAB-Loss, a loss function is introduced, combining a focal loss with IOU and active boundary loss (ABL). This composite loss function strengthens the model's focus on challenging-to-distinguish categories. Extensive experiments conducted on three datasets, including the semantic segmentation of lakes in the Tibetan Plateau and the ISPRS's Vaihingen benchmark, validate the efficacy of the proposed method. The experimental results indicate that the network exhibits exceptional performance in processing VHR images and accurately extracting edge features.

Dual attention deep fusion semantic segmentation networks of large-scale satellite remote-sensing images

Deep Dual-Stream Network with Scale Context Selection Attention Module for Semantic Segmentation

An Attention-Fused Network for Semantic Segmentation of Very-High-Resolution Remote Sensing Imagery

Densely Based Multi-Scale and Multi-Modal Fully Convolutional Networks for High-Resolution Remote-Sensing Image Semantic Segmentation

Remote Sensing Image Semantic Segmentation Method Based on a Deep Convolutional Neural Network and Multiscale Feature Fusion

Hierarchical Self-Attention Embedded Neural Network With Dense Connection for Remote-Sensing Image Semantic Segmentation

Dual-Path Multi-Level Feature Fusion Network for Semantic Segmentation of Remote Sensing Image

Dual-Path Feature Fusion Network for Semantic Segmentation of Remote Sensing Images

High-Resolution Aerial Images Semantic Segmentation Using Deep Fully Convolutional Network with Channel Attention Mechanism

Dual Path Attention Net For Remote Sensing Semantic Image Segmentation

Semantic Segmentation Network Based on Adaptive Attention and Deep Fusion Utilizing a Multi-Scale Dilated Convolutional Pyramid

DEANet: Dual Encoder with Attention Network for Semantic Segmentation of Remote Sensing Imagery

Lightweight Attention Network for Very High-Resolution Image Semantic Segmentation

A New Multi-Channel Deep Convolutional Neural Network for Semantic Segmentation of Remote Sensing Image.

Dual Attention Feature Fusion and Adaptive Context for Accurate Segmentation of Very High-Resolution Remote Sensing Images

Semantic Segmentation of Aerial Imagery Via Split-Attention Networks with Disentangled Nonlocal and Edge Supervision

AFNet: Adaptive Fusion Network for Remote Sensing Image Semantic Segmentation

DESformer: A Dual-branch Encoding Strategy for Semantic Segmentation of Very-High-Resolution Remote Sensing Images Based on Feature Interaction and Multi-Scale Context Fusion

LKASeg:Remote-Sensing Image Semantic Segmentation with Large Kernel Attention and Full-Scale Skip Connections

Accurate Semantic Segmentation in Remote Sensing Image.

Multi-Scale Adaptive Feature Fusion Network For Semantic Segmentation In Remote Sensing Images