Abstract:Both high-level and high-resolution feature representations are of great importance in various visual understanding tasks. To acquire high-resolution feature maps with high-level semantic information, one common strategy is to adopt dilated convolutions in the backbone networks to extract high-resolution feature maps, such as the dilatedFCN-based methods for semantic segmentation. However, due to many convolution operations are conducted on the high-resolution feature maps, such methods have large computational complexity and memory consumption. To balance the performance and efficiency, there also exist encoder-decoder structures that gradually recover the spatial information by combining multi-level feature maps from a feature encoder, such as the FPN architecture for object detection and the U-Net for semantic segmentation. Although being more efficient, the performances of existing encoder-decoder methods for semantic segmentation are far from comparable with the dilatedFCN-based methods. In this paper, we propose one novel holistically-guided decoder which is introduced to obtain the high-resolution semantic-rich feature maps via the multi-scale features from the encoder. The decoding is achieved via novel holistic codeword generation and codeword assembly operations, which take advantages of both the high-level and low-level features from the encoder features. With the proposed holistically-guided decoder, we implement the EfficientFCN architecture for semantic segmentation and HGD-FPN for object detection and instance segmentation. The EfficientFCN achieves comparable or even better performance than state-of-the-art methods with only 1/3 of their computational costs for semantic segmentation on PASCAL Context, PASCAL VOC, ADE20K datasets. Meanwhile, the proposed HGD-FPN achieves $>2\%$>2% higher mean Average Precision (mAP) when integrated into several object detection frameworks with ResNet-50 encoding backbones.

Dual-path decoder architecture for semantic segmentation of wheat ears

Deep Dual-Stream Network with Scale Context Selection Attention Module for Semantic Segmentation

Dual-Path Feature Fusion Network for Semantic Segmentation of Remote Sensing Images

Dual Context Prior and Refined Prediction for Semantic Segmentation

DPNet: Dual-Pyramid Semantic Segmentation Network Based on Improved Deeplabv3 Plus

Encoder-decoder with double spatial pyramid for semantic segmentation.

Wheat Grain Image Segmentation Based on Improved Fully Convolutional Network

Improving Segmentation Accuracy for Ears of Winter Wheat at Flowering Stage by Semantic Segmentation

Dual-Path Feature Aware Network for Remote Sensing Image Semantic Segmentation

Semantic Segmentation Via Structured Refined Prediction and Dual Global Priors.

Attention-based Dual Supervised Decoder for RGBD Semantic Segmentation

Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation

Efficient Parallel Multi-Scale Detail and Semantic Encoding Network for Lightweight Semantic Segmentation

Decoders Matter for Semantic Segmentation: Data-Dependent Decoding Enables Flexible Feature Aggregation

Dual-Path Sparse Hierarchical Network for Semantic Segmentation of Remote Sensing Images

Adaptive Spatial-BCE Loss for Weakly Supervised Semantic Segmentation.

DualSeg: Fusing transformer and CNN structure for image segmentation in complex vineyard environment

A Holistically-Guided Decoder for Deep Representation Learning with Applications to Semantic Segmentation and Object Detection.

Dual-Path Multi-Level Feature Fusion Network for Semantic Segmentation of Remote Sensing Image

Bi-directional Cross-Modality Feature Propagation with Separation-and-Aggregation Gate for RGB-D Semantic Segmentation

An accurate semantic segmentation model for bean seedlings and weeds identification based on improved ERFnet