Abstract:Semantic segmentation of remote sensing imagery (RSI) has obtained great success with the development of deep convolutional neural networks (DCNNs). However, most of the existing algorithms focus on designing end-to-end DCNNs, but neglecting to consider the difficulty of segmentation in imbalance categories, especially for minority categories in RSI, which limits the performance of RSI semantic segmentation. In this paper, a novel edge guided context aggregation network (EGCAN) is proposed for the semantic segmentation of RSI. The Unet is employed as backbone. Meanwhile, an edge guided context aggregation branch and minority categories extraction branch are designed for a comprehensive enhancement of semantic modeling. Specifically, the edge guided context aggregation branch is proposed to promote entire semantic comprehension of RSI and further emphasize the representation of edge information, which consists of three modules: edge extraction module (EEM), dual expectation maximization attention module (DEMA), and edge guided module (EGM). EEM is created primarily for accurate edge tracking. According to that, DEMA aggregates global contextual features with different scales and the edge features along spatial and channel dimensions. Subsequently, EGM cascades the aggregated features into the decoder process to capture long-range dependencies and further emphasize the error-prone pixels in the edge region to acquire better semantic labels. Besides this, the exploited minority categories extraction branch is presented to acquire rich multi-scale contextual information through an elaborate hybrid spatial pyramid pooling module (HSPP) to distinguish categories taking a small percentage and background. On the Tianzhi Cup dataset, the proposed algorithm EGCAN achieved an overall accuracy of 84.1% and an average cross-merge ratio of 68.1%, with an accuracy improvement of 0.4% and 1.3% respectively compared to the classical Deeplabv3+ model. Extensive experimental results on the dataset released in ISPRS Vaihingen and Potsdam benchmarks also demonstrate the effectiveness of the proposed EGCAN over other state-of-the-art approaches.

A Cross-Domain Coupling Network for Semantic Segmentation of Remote Sensing Images

A Spectral–Spatial Context-Boosted Network for Semantic Segmentation of Remote Sensing Images

Muti-Scale Context-Aware Network for Cross-Domain Unsupervised Remote Sensing Image Semantic Segmentation

Hybridizing Cross-Level Contextual and Attentive Representations for Remote Sensing Imagery Semantic Segmentation

Cross-Scale Feature Propagation Network for Semantic Segmentation of High-Resolution Remote Sensing Images

Densely Based Multi-Scale and Multi-Modal Fully Convolutional Networks for High-Resolution Remote-Sensing Image Semantic Segmentation

Scale–Relation Joint Decoupling Network for Remote Sensing Image Semantic Segmentation

SSCNet: A Spectrum-Space Collaborative Network for Semantic Segmentation of Remote Sensing Images

Cross-scale Graph Interaction Network for Semantic Segmentation of Remote Sensing Images

Remote Sensing Image Semantic Segmentation Method Based on a Deep Convolutional Neural Network and Multiscale Feature Fusion

DHRNet: A Dual-Branch Hybrid Reinforcement Network for Semantic Segmentation of Remote Sensing Images

Semantic Segmentation of Remote Sensing Images with Multi-scale Features and Attention Mechanism

Multi-Scale Context Aggregation for Semantic Segmentation of Remote Sensing Images.

HRCNet: High-Resolution Context Extraction Network for Semantic Segmentation of Remote Sensing Images

Edge Guided Context Aggregation Network for Semantic Segmentation of Remote Sensing Imagery

Context Enhancing Representation for Semantic Segmentation in Remote Sensing Images.

High-Order Semantic Decoupling Network for Remote Sensing Image Semantic Segmentation

Boundary-enhanced dual-stream network for semantic segmentation of high-resolution remote sensing images

A Frequency Domain Feature-Guided Network for Semantic Segmentation of Remote Sensing Images

Scale-Semantic Joint Decoupling Network for Image-text Retrieval in Remote Sensing

DOCNet: Dual-Domain Optimized Class-Aware Network for Remote Sensing Image Segmentation