Abstract:The dominant backbones of neural networks for scene parsing consist of multiple stages, where feature maps in different stages often contain varying levels of spatial and semantic information. High-level features convey more semantics and fewer spatial details, while low-level features possess fewer semantics and more spatial details. Consequently, there are semantic-spatial gaps among features at different levels, particularly in human parsing tasks. Many existing approaches directly upsample multi-stage features and aggregate them through addition or concatenation, without addressing the semantic-spatial gaps present among these features. This inevitably leads to spatial misalignment, semantic mismatch, and ultimately misclassification in parsing, especially for human parsing that demands more semantic information and more fine details of feature maps for the reason of intricate textures, diverse clothing styles, and heavy scale variability across different human parts. In this paper, we effectively alleviate the long-standing challenge of addressing semantic-spatial gaps between features from different stages by innovatively utilizing the subtraction and addition operations to recognize the semantic and spatial differences and compensate for them. Based on these principles, we propose the Channel and Spatial Enhancement Network (CSENet) for parsing, offering a straightforward and intuitive solution for addressing semantic-spatial gaps via injecting high-semantic information to lower-stage features and vice versa, introducing fine details to higher-stage features. Extensive experiments on three dense prediction tasks have demonstrated the efficacy of our method. Specifically, our method achieves the best performance on the LIP and CIHP datasets and we also verify the generality of our method on the ADE20K dataset.

Multi-Path Feedback Recurrent Neural Network for Scene Parsing

Recurrent Convolutional Neural Networks for Scene Parsing

Scene Parsing via Dense Recurrent Neural Networks with Attentional Selection

MoE-SPNet: A Mixture-of-experts Scene Parsing Network.

MASTER: Multi-Aspect Non-local Network for Scene Text Recognition

Multi-layer Feature Aggregation for Deep Scene Parsing Models

Fast and Accurate Scene Parsing Via Bi-direction Alignment Networks

Geometric Scene Parsing with Hierarchical LSTM

Scene Parsing with Multiscale Feature Learning, Purity Trees, and Optimal Covers

Scene Parsing Using Inference Embedded Deep Networks

EFRNet: Efficient Feature Reconstructing Network for Real-Time Scene Parsing

A holistic representation guided attention network for scene text recognition

From Simple to Complex Scenes: Learning Robust Feature Representations for Accurate Human Parsing

Channel and Spatial Enhancement Network for human parsing

Face Parsing via Recurrent Propagation

Unified Perceptual Parsing for Scene Understanding

EKENet: Efficient knowledge enhanced network for real-time scene parsing

Lightweight cross-guided contextual perceptive network for visible–infrared urban road scene parsing

Meta Parsing Networks: Towards Generalized Few-shot Scene Parsing with Adaptive Metric Learning

Multi-Branch Adaptive Hard Region Mining Network for Urban Scene Parsing of High-Resolution Remote-Sensing Images

Multi-Label Remote Sensing Image Scene Classification by Combining a Convolutional Neural Network and a Graph Neural Network