Abstract:The dominant backbones of neural networks for scene parsing consist of multiple stages, where feature maps in different stages often contain varying levels of spatial and semantic information. High-level features convey more semantics and fewer spatial details, while low-level features possess fewer semantics and more spatial details. Consequently, there are semantic-spatial gaps among features at different levels, particularly in human parsing tasks. Many existing approaches directly upsample multi-stage features and aggregate them through addition or concatenation, without addressing the semantic-spatial gaps present among these features. This inevitably leads to spatial misalignment, semantic mismatch, and ultimately misclassification in parsing, especially for human parsing that demands more semantic information and more fine details of feature maps for the reason of intricate textures, diverse clothing styles, and heavy scale variability across different human parts. In this paper, we effectively alleviate the long-standing challenge of addressing semantic-spatial gaps between features from different stages by innovatively utilizing the subtraction and addition operations to recognize the semantic and spatial differences and compensate for them. Based on these principles, we propose the Channel and Spatial Enhancement Network (CSENet) for parsing, offering a straightforward and intuitive solution for addressing semantic-spatial gaps via injecting high-semantic information to lower-stage features and vice versa, introducing fine details to higher-stage features. Extensive experiments on three dense prediction tasks have demonstrated the efficacy of our method. Specifically, our method achieves the best performance on the LIP and CIHP datasets and we also verify the generality of our method on the ADE20K dataset.

FCPN: Pruning redundant part-whole relations for more streamlined pattern parsing

Reducing Vulnerable Internal Feature Correlations to Enhance Efficient Topological Structure Parsing

CtFPPN: A coarse-to-fine pattern parser for dealing with distribution imbalance of pixels

PCPL: Predicate-Correlation Perception Learning for Unbiased Scene Graph Generation

Correlating Edge, Pose With Parsing

Editorial for Pattern Recognition Letters Special Issue on Face-Based Emotion Understanding

CLRNet: Component-Level Refinement Network for Deep Face Parsing

Hierarchical Human Semantic Parsing With Comprehensive Part-Relation Modeling

Channel and Spatial Enhancement Network for human parsing

Hierarchical Human Parsing with Typed Part-Relation Reasoning

Toward Achieving Robust Low-Level and High-Level Scene Parsing

Parsing TCT with a Coarse-to-fine Approach.

3D Face Parsing via Surface Parameterization and 2D Semantic Segmentation Network

Rethinking the Mechanism of the Pattern Pruning and the Circle Importance Hypothesis

Phase Contour Enhancement Network for Clothing Parsing

Parsing Objects at a Finer Granularity: A Survey

Dependency Parsing with Partial Annotations: an Empirical Comparison.

Progressive Parsing and Commonality Distillation for Few-Shot Remote Sensing Segmentation.

Deep Hierarchical Human Semantic Parsing

Towards Accurate and Efficient Chinese Part-of-Speech Tagging.

Parsing-based Chinese word segmentation integrating morphological and syntactic information