Abstract:Semantic segmentation is a fundamental task in remote sensing image processing. The large appearance variations of ground objects make this task quite challenging. Recently, deep convolutional neural networks (DCNNs) have shown outstanding performance in this task. A common strategy of these methods (e.g., SegNet) for performance improvement is to combine the feature maps learned at different DCNN layers. However, such a combination is usually implemented via feature map summation or concatenation, indicating that the features are considered indiscriminately. In fact, features at different positions contribute differently to the final performance. It is advantageous to automatically select adaptive features when merging different-layer feature maps. To achieve this goal, we propose a gated convolutional neural network to fulfill this task. Specifically, we explore the relationship between the information entropy of the feature maps and the label-error map, and then a gate mechanism is embedded to integrate the feature maps more effectively. The gate is implemented by the entropy maps, which are generated to assign adaptive weights to different feature maps as their relative importance. Generally, the entropy maps, i.e., the gates, guide the network to focus on the highly-uncertain pixels, where detailed information from lower layers is required to improve the separability of these pixels. The selected features are finally combined to feed into the classifier layer, which predicts the semantic label of each pixel. The proposed method achieves competitive segmentation accuracy on the public ISPRS 2D Semantic Labeling benchmark, which is challenging for segmentation by only using the RGB images.

Wide Residual Networks for Semantic Segmentation

Image Semantic Segmentation Based on Region and Deep Residual Network

WideSegNeXt: Semantic Image Segmentation Using Wide Residual Network and NeXt Dilated Unit

Omnisupervised Omnidirectional Semantic Segmentation

High-performance Semantic Segmentation Using Very Deep Fully Convolutional Networks

Fully Convolutional Networks for Semantic Segmentation

A Deep Semantic Segmentation Network with Semantic and Contextual Refinements

ResSCNN: A Semantic Segmentation Method for Fast Processing of Large-Scale Input

ResNet with Global and Local Image Features, Stacked Pooling Block, for Semantic Segmentation.

Object-Enhanced Semantic Segmentation Model for High-Resolution Remote Sensing Images

Integrating Spatial Details with Long-Range Contexts for Semantic Segmentation of Very High-Resolution Remote-Sensing Images.

Image Semantic Segmentation Method with Fusion of Transposed Convolution and Deep Residual

Transformer and CNN Hybrid Deep Neural Network for Semantic Segmentation of Very-High-Resolution Remote Sensing Imagery

DA-Res2Net: a Novel Densely Connected Residual Attention Network for Image Semantic Segmentation.

Semantic Segmentation Based on Deep Convolution Neural Network

Classification of Very High-Resolution Remote Sensing Imagery Using a Fully Convolutional Network with Global and Local Context Information Enhancements.

Semantic Segmentation with Multi-Path Refinement and Pyramid Pooling Dilated-Resnet.

Semantic Segmentation Via Structured Refined Prediction and Dual Global Priors.

CNN-based Semantic Segmentation using Level Set Loss

Gated Convolutional Neural Network for Semantic Segmentation in High-Resolution Images

Deep Context Convolutional Neural Networks for Semantic Segmentation.