Abstract:Semantic segmentation is a fundamental task in remote sensing image processing. The large appearance variations of ground objects make this task quite challenging. Recently, deep convolutional neural networks (DCNNs) have shown outstanding performance in this task. A common strategy of these methods (e.g., SegNet) for performance improvement is to combine the feature maps learned at different DCNN layers. However, such a combination is usually implemented via feature map summation or concatenation, indicating that the features are considered indiscriminately. In fact, features at different positions contribute differently to the final performance. It is advantageous to automatically select adaptive features when merging different-layer feature maps. To achieve this goal, we propose a gated convolutional neural network to fulfill this task. Specifically, we explore the relationship between the information entropy of the feature maps and the label-error map, and then a gate mechanism is embedded to integrate the feature maps more effectively. The gate is implemented by the entropy maps, which are generated to assign adaptive weights to different feature maps as their relative importance. Generally, the entropy maps, i.e., the gates, guide the network to focus on the highly-uncertain pixels, where detailed information from lower layers is required to improve the separability of these pixels. The selected features are finally combined to feed into the classifier layer, which predicts the semantic label of each pixel. The proposed method achieves competitive segmentation accuracy on the public ISPRS 2D Semantic Labeling benchmark, which is challenging for segmentation by only using the RGB images.

Enlarging Effective Receptive Field of Convolutional Neural Networks for Better Semantic Segmentation

High-Resolution Remote Sensing Image Semantic Segmentation Method Based on Improved Encoder-Decoder Convolutional Neural Network

Understanding the Effective Receptive Field in Semantic Image Segmentation

Improved Image Segmentation Algorithms based on Convolutional Neural Networks

Improving Fully Convolution Network for Semantic Segmentation

Improving Semantic Image Segmentation with a Probabilistic Superpixel-Based Dense Conditional Random Field.

Multilevel feature fusion dilated convolutional network for semantic segmentation

Semantic Segmentation with Multi-Path Refinement and Pyramid Pooling Dilated-Resnet.

Optimizing Spatial Relationships in GCN to Improve the Classification Accuracy of Remote Sensing Images

Fully Convolutional Neural Networks With Full-Scale-Features For Semantic Segmentation

FC-RCCN: Fully Convolutional Residual Continuous CRF Network for Semantic Segmentation

Attention Guided Global Enhancement and Local Refinement Network for Semantic Segmentation

Deep Context Convolutional Neural Networks for Semantic Segmentation.

A Serial-Parallel Self-Attention Network Joint with Multi-Scale Dilated Convolution.

Gated Convolutional Neural Network for Semantic Segmentation in High-Resolution Images

Multi-Receptive Atrous Convolutional Network for Semantic Segmentation.

Dense Convolutional Networks for Semantic Segmentation.

Semantic image segmentation using fully convolutional neural networks with multi-scale images and multi-scale dilated convolutions

Fully Convolutional Networks for Semantic Segmentation

Multi-scale deep context convolutional neural networks for semantic segmentation

Semantic Segmentation Network Based on Adaptive Attention and Deep Fusion Utilizing a Multi-Scale Dilated Convolutional Pyramid