Abstract:Semantic segmentation of high-resolution remote sensing images is highly challenging due to the presence of a complicated background, irregular target shapes, and similarities in the appearance of multiple target categories. Most of the existing segmentation methods that rely only on simple fusion of the extracted multi-scale features often fail to provide satisfactory results when there is a large difference in the target sizes. Handling this problem through multi-scale context extraction and efficient fusion of multi-scale features, in this paper we present an end-to-end multi-scale adaptive feature fusion network (MANet) for semantic segmentation in remote sensing images. It is a coding and decoding structure that includes a multi-scale context extraction module (MCM) and an adaptive fusion module (AFM). The MCM employs two layers of atrous convolutions with different dilatation rates and global average pooling to extract context information at multiple scales in parallel. MANet embeds the channel attention mechanism to fuse semantic features. The high- and low-level semantic information are concatenated to generate global features via global average pooling. These global features are used as channel weights to acquire adaptive weight information of each channel by the fully connected layer. To accomplish an efficient fusion, these tuned weights are applied to the fused features. Performance of the proposed method has been evaluated by comparing it with six other state-of-the-art networks: fully convolutional networks (FCN), U-net, UZ1, Light-weight RefineNet, DeepLabv3+, and APPD. Experiments performed using the publicly available Potsdam and Vaihingen datasets show that the proposed MANet significantly outperforms the other existing networks, with overall accuracy reaching 89.4% and 88.2%, respectively and with average of F1 reaching 90.4% and 86.7% respectively.

Remote Sensing Image Segmentation Network Based on Adaptive Multiscale and Contour Gradient

Remote Sensing Image Segmentation Network Based on Adaptive Multiscale and Contour Gradient

Multi-scale Spatial Aggregation Network for Remote Sensing Image Segmentation

Remote Sensing Image Semantic Segmentation Method Based on a Deep Convolutional Neural Network and Multiscale Feature Fusion

MFCSNet: Multi-Scale Deep Features Fusion and Cost-Sensitive Loss Function Based Segmentation Network for Remote Sensing Images

Optimizing Spatial Relationships in GCN to Improve the Classification Accuracy of Remote Sensing Images

A multiscale bidirectional fuzzy-driven learning network for remote sensing image segmentation

Multi-Scale Adaptive Feature Fusion Network For Semantic Segmentation In Remote Sensing Images

MOA-Net: Multilevel Object Aware Network for Remote Sensing Image Semantic Segmentation

MDMASNet: A dual-task interactive semi-supervised remote sensing image segmentation method

Dual Path Attention Net For Remote Sensing Semantic Image Segmentation

High-Resolution Remote Sensing Image Semantic Segmentation via Multiscale Context and Linear Self-Attention

MIGN: Multiscale Image Generation Network for Remote Sensing Image Semantic Segmentation

Scale-Aware Neural Network for Semantic Segmentation of Multi-Resolution Remote Sensing Images

Encoder- and Decoder-Based Networks Using Multiscale Feature Fusion and Nonlocal Block for Remote Sensing Image Semantic Segmentation

Multi-Stage Fusion and Multi-Source Attention Network for Multi-Modal Remote Sensing Image Segmentation.

Deep Attention And Multi-Scale Networks For Accurate Remote Sensing Image Segmentation

Densely Based Multi-Scale and Multi-Modal Fully Convolutional Networks for High-Resolution Remote-Sensing Image Semantic Segmentation

Remote Sensing Image Semantic Segmentation Network Based on Multi-Scale Feature Enhancement Fusion

Efficient Multi-scale Network for Semantic Segmentation of fine-Resolution Remotely Sensed Images

A New Multi-Channel Deep Convolutional Neural Network for Semantic Segmentation of Remote Sensing Image.