Abstract:Semantic segmentation of high-resolution remote sensing images is highly challenging due to the presence of a complicated background, irregular target shapes, and similarities in the appearance of multiple target categories. Most of the existing segmentation methods that rely only on simple fusion of the extracted multi-scale features often fail to provide satisfactory results when there is a large difference in the target sizes. Handling this problem through multi-scale context extraction and efficient fusion of multi-scale features, in this paper we present an end-to-end multi-scale adaptive feature fusion network (MANet) for semantic segmentation in remote sensing images. It is a coding and decoding structure that includes a multi-scale context extraction module (MCM) and an adaptive fusion module (AFM). The MCM employs two layers of atrous convolutions with different dilatation rates and global average pooling to extract context information at multiple scales in parallel. MANet embeds the channel attention mechanism to fuse semantic features. The high- and low-level semantic information are concatenated to generate global features via global average pooling. These global features are used as channel weights to acquire adaptive weight information of each channel by the fully connected layer. To accomplish an efficient fusion, these tuned weights are applied to the fused features. Performance of the proposed method has been evaluated by comparing it with six other state-of-the-art networks: fully convolutional networks (FCN), U-net, UZ1, Light-weight RefineNet, DeepLabv3+, and APPD. Experiments performed using the publicly available Potsdam and Vaihingen datasets show that the proposed MANet significantly outperforms the other existing networks, with overall accuracy reaching 89.4% and 88.2%, respectively and with average of F1 reaching 90.4% and 86.7% respectively.

Adaptive multi-scale dual attention network for semantic segmentation

Deep Dual-Stream Network with Scale Context Selection Attention Module for Semantic Segmentation

Multi‐stream Densely Connected Network for Semantic Segmentation

MEDANet: More Efficient Dual Attention Network for Scene Segmentation

Enhanced Multi-Scale Feature Adaptive Fusion Sparse Convolutional Network for Large-Scale Scenes Semantic Segmentation

DMANet: Dual-branch Multiscale Attention Network for Real-Time Semantic Segmentation

Semantic Segmentation Network Based on Adaptive Attention and Deep Fusion Utilizing a Multi-Scale Dilated Convolutional Pyramid

DARSegNet: A Real-Time Semantic Segmentation Method Based on Dual Attention Fusion Module and Encoder-Decoder Network

DSANet: Dilated Spatial Attention for Real-Time Semantic Segmentation in Urban Street Scenes.

Superdense-scale Network for Semantic Segmentation

Multi-Path Spatial Detail-Aware Network for Semantic Segmentation

Semantic Segmentation Network with Multi-Path Structure, Attention Reweighting and Multi-Scale Encoding

Semantic segmentation of autonomous driving scenes based on multi-scale adaptive attention mechanism

Based on cross-scale fusion attention mechanism network for semantic segmentation for street scenes

A Serial-Parallel Self-Attention Network Joint with Multi-Scale Dilated Convolution.

DAABNet: depth-wise asymmetric attention bottleneck for real-time semantic segmentation

Efficient Parallel Multi-Scale Detail and Semantic Encoding Network for Lightweight Semantic Segmentation

Hybrid Dilated Convolution Network Using Attentive Kernels for Real-Time Semantic Segmentation

Multiattention Network for Semantic Segmentation of Fine-Resolution Remote Sensing Images

Attention based lightweight asymmetric network for real-time semantic segmentation

Multi-Scale Adaptive Feature Fusion Network For Semantic Segmentation In Remote Sensing Images