Abstract:Most existing segmentation networks are built upon a “U-shaped” encoder–decoder structure, where the multi-level features extracted by the encoder are gradually aggregated by the decoder. Although this structure has been proven to be effective in improving segmentation performance, there are two main drawbacks. On the one hand, the introduction of low-level features brings a significant increase in calculations without an obvious performance gain. On the other hand, general strategies of feature aggregation such as addition and concatenation fuse features without considering the usefulness of each feature vector, which mixes the useful information with massive noises. In this article, we abandon the traditional “U-shaped” architecture and propose Y-Net, a dual-branch joint network for accurate semantic segmentation. Specifically, it only aggregates the high-level features with low-resolution and utilizes the global context guidance generated by the first branch to refine the second branch. The dual branches are effectively connected through a Semantic Enhancing Module, which can be regarded as the combination of spatial attention and channel attention. We also design a novel Channel-Selective Decoder (CSD) to adaptively integrate features from different receptive fields by assigning specific channelwise weights, where the weights are input-dependent. Our Y-Net is capable of breaking through the limit of singe-branch network and attaining higher performance with less computational cost than “U-shaped” structure. The proposed CSD can better integrate useful information and suppress interference noises. Comprehensive experiments are carried out on three public datasets to evaluate the effectiveness of our method. Eventually, our Y-Net achieves state-of-the-art performance on PASCAL VOC 2012, PASCAL Person-Part, and ADE20K dataset without pre-training on extra datasets.

An Adaptive Post-Processing Network with the Global-Local Aggregation for Semantic Segmentation

APPFNet: Adaptive point-pixel fusion network for 3D semantic segmentation with neighbor feature aggregation

Attention Guided Global Enhancement and Local Refinement Network for Semantic Segmentation

Adaptive Pyramid Context Network for Semantic Segmentation

Global Context Dependencies Aware Network for Efficient Semantic Segmentation of Fine-Resolution Remoted Sensing Images

Patch Proposal Network for Fast Semantic Segmentation of High-Resolution Images

Progressive Neighborhood Aggregation for Semantic Segmentation Refinement.

APP-Net: Auxiliary-Point-Based Push and Pull Operations for Efficient Point Cloud Recognition

APNet: Attention Mechanism with Point Sampling Loss Network for Remote Sensing Images Semantic Segmentation

Global Aggregation then Local Distribution for Scene Parsing

Real-Time Semantic Segmentation via Spatial-Detail Guided Context Propagation

Semantic Relocation Parallel Network for Semantic Segmentation

Cross Guided and Pyramid Aggregation Networks for Real-time Semantic Segmentation

Adaptive Activation Network for Weakly Supervised Semantic Segmentation

Asymmetric Non-Local Neural Networks for Semantic Segmentation.

LPASS-Net: Lightweight Progressive Attention Semantic Segmentation Network for Automatic Segmentation of Remote Sensing Images.

Y-Net: Dual-branch Joint Network for Semantic Segmentation.

Gated Path Selection Network for Semantic Segmentation

Hybrid Dilated Convolution Network Using Attentive Kernels for Real-Time Semantic Segmentation

Efficiently Expanding Receptive Fields: Local Split Attention and Parallel Aggregation for Enhanced Large-scale Point Cloud Semantic Segmentation

Region-and-Attention Network for Semantic Segmentation