Abstract:Semantic segmentation in high-resolution remote-sensing (RS) images is a fundamental task for RS-based urban understanding and planning. However, various types of artificial objects in urban areas make this task quite challenging. Recently, the use of Deep Convolutional Neural Networks (DCNNs) with multiscale information fusion has demonstrated great potential in enhancing performance. Technically, however, existing fusions are usually implemented by summing or concatenating feature maps in a straightforward way. Seldom do works consider the spatial importance for global-to-local context-information aggregation. This paper proposes a Learnable-Gated CNN (L-GCNN) to address this issue. Methodologically, the Taylor expression of the information-entropy function is first parameterized to design the gate function, which is employed to generate pixelwise weights for coarse-to-fine refinement in the L-GCNN. Accordingly, a Parameterized Gate Module (PGM) was designed to achieve this goal. Then, the single PGM and its densely connected extension were embedded into different levels of the encoder in the L-GCNN to help identify the discriminative feature maps at different scales. With the above designs, the L-GCNN is finally organized as a self-cascaded end-to-end architecture that is able to sequentially aggregate context information for fine segmentation. The proposed model was evaluated on two public challenging benchmarks, the ISPRS 2Dsemantic segmentation challenge Potsdam dataset and the Massachusetts building dataset. The experiment results demonstrate that the proposed method exhibited significant improvement compared with several related segmentation networks, including the FCN, SegNet, RefineNet, PSPNet, DeepLab and GSN.For example, on the Potsdam dataset, our method achieved a 93.65% F1 score and 88.06% IoU score for the segmentation of tiny cars in high-resolution RS images. As a conclusion, the proposed model showed potential for object segmentation from the RS images of buildings, impervious surfaces, low vegetation, trees and cars in urban settings, which largely varies in size and have confusing appearances.

Self-constructing graph neural networks to model long-range pixel dependencies for semantic segmentation of remote sensing images

SGA-Net: Self-Constructing Graph Attention Neural Network for Semantic Segmentation of Remote Sensing Images

Optimizing Spatial Relationships in GCN to Improve the Classification Accuracy of Remote Sensing Images

An Attention Enhanced Graph Convolutional Network for Semantic Segmentation

CGGLNet: Semantic Segmentation Network for Remote Sensing Images Based on Category-Guided Global–Local Feature Interaction

Semantic Segmentation for High-Resolution Remote-Sensing Images Via Dynamic Graph Context Reasoning

Global Context Dependencies Aware Network for Efficient Semantic Segmentation of Fine-Resolution Remoted Sensing Images

Graph Attention Guidance Network with Knowledge Distillation for Semantic Segmentation of Remote Sensing Images.

Learnable Gated Convolutional Neural Network for Semantic Segmentation in Remote-Sensing Images

Dual Graph Convolutional Network for Semantic Segmentation.

Negative Class Guided Spatial Consistency Network for Sparsely Supervised Semantic Segmentation of Remote Sensing Images

Cross-scale Graph Interaction Network for Semantic Segmentation of Remote Sensing Images

LightFGCNet: A Lightweight and Focusing on Global Context Information Semantic Segmentation Network for Remote Sensing Imagery

Knowledge and Spatial Pyramid Distance-Based Gated Graph Attention Network for Remote Sensing Semantic Segmentation

Knowledge and Geo-Object Based Graph Convolutional Network for Remote Sensing Semantic Segmentation

Context Spatial Awareness Remote Sensing Image Change Detection Network Based on Graph and Convolution Interaction

Context Enhancing Representation for Semantic Segmentation in Remote Sensing Images.

Superpixel-Based Attention Graph Neural Network for Semantic Segmentation in Aerial Images

UGCNet: An Unsupervised Semantic Segmentation Network Embedded With Geometry Consistency for Remote-Sensing Images

Graph-Guided Architecture Search for Real-Time Semantic Segmentation

Scale-Aware Neural Network for Semantic Segmentation of Multi-Resolution Remote Sensing Images