Abstract:Semantic segmentation is a fundamental task in remote sensing image processing. The large appearance variations of ground objects make this task quite challenging. Recently, deep convolutional neural networks (DCNNs) have shown outstanding performance in this task. A common strategy of these methods (e.g., SegNet) for performance improvement is to combine the feature maps learned at different DCNN layers. However, such a combination is usually implemented via feature map summation or concatenation, indicating that the features are considered indiscriminately. In fact, features at different positions contribute differently to the final performance. It is advantageous to automatically select adaptive features when merging different-layer feature maps. To achieve this goal, we propose a gated convolutional neural network to fulfill this task. Specifically, we explore the relationship between the information entropy of the feature maps and the label-error map, and then a gate mechanism is embedded to integrate the feature maps more effectively. The gate is implemented by the entropy maps, which are generated to assign adaptive weights to different feature maps as their relative importance. Generally, the entropy maps, i.e., the gates, guide the network to focus on the highly-uncertain pixels, where detailed information from lower layers is required to improve the separability of these pixels. The selected features are finally combined to feed into the classifier layer, which predicts the semantic label of each pixel. The proposed method achieves competitive segmentation accuracy on the public ISPRS 2D Semantic Labeling benchmark, which is challenging for segmentation by only using the RGB images.

GFF: Gated Fully Fusion for Semantic Segmentation

GFFNet: Global Feature Fusion Network for Semantic Segmentation of Large-Scale Remote Sensing Images

FFNet: Feature Fusion Network for Few-shot Semantic Segmentation

DFFNet: An IoT-perceptive dual feature fusion network for general real-time semantic segmentation

Research of improving semantic image segmentation based on a feature fusion model

Enhanced Multi-Scale Feature Adaptive Fusion Sparse Convolutional Network for Large-Scale Scenes Semantic Segmentation

Enhanced Feature Pyramid Network for Semantic Segmentation.

CFFNet: Cross-scale Feature Fusion Network for Real-Time Semantic Segmentation

LFFNet: lightweight feature-enhanced fusion network for real-time semantic segmentation of road scenes

MFEAFN: Multi-scale feature enhanced adaptive fusion network for image semantic segmentation

A Multi-level Feature Fusion Network for Real-time Semantic Segmentation

A Deep Fully Convolution Neural Network for Semantic Segmentation Based on Adaptive Feature Fusion

GAF-Net: Geometric Contextual Feature Aggregation and Adaptive Fusion for Large-Scale Point Cloud Semantic Segmentation

GLF-Net: A Semantic Segmentation Model Fusing Global and Local Features for High-Resolution Remote Sensing Images

Inter-Level Feature Balanced Fusion Network for Street Scene Segmentation

MCFNet: Multi-scale Covariance Feature Fusion Network for Real-time Semantic Segmentation

Gated Convolutional Neural Network for Semantic Segmentation in High-Resolution Images

Enhancing Feature Fusion with Spatial Aggregation and Channel Fusion for Semantic Segmentation

Feature Fusion Network Based on Hybrid Attention for Semantic Segmentation

Dual-Path Multi-Level Feature Fusion Network for Semantic Segmentation of Remote Sensing Image

Multi-layer Adaptive Feature Fusion for Semantic Segmentation