Abstract:The dominant backbones of neural networks for scene parsing consist of multiple stages, where feature maps in different stages often contain varying levels of spatial and semantic information. High-level features convey more semantics and fewer spatial details, while low-level features possess fewer semantics and more spatial details. Consequently, there are semantic-spatial gaps among features at different levels, particularly in human parsing tasks. Many existing approaches directly upsample multi-stage features and aggregate them through addition or concatenation, without addressing the semantic-spatial gaps present among these features. This inevitably leads to spatial misalignment, semantic mismatch, and ultimately misclassification in parsing, especially for human parsing that demands more semantic information and more fine details of feature maps for the reason of intricate textures, diverse clothing styles, and heavy scale variability across different human parts. In this paper, we effectively alleviate the long-standing challenge of addressing semantic-spatial gaps between features from different stages by innovatively utilizing the subtraction and addition operations to recognize the semantic and spatial differences and compensate for them. Based on these principles, we propose the Channel and Spatial Enhancement Network (CSENet) for parsing, offering a straightforward and intuitive solution for addressing semantic-spatial gaps via injecting high-semantic information to lower-stage features and vice versa, introducing fine details to higher-stage features. Extensive experiments on three dense prediction tasks have demonstrated the efficacy of our method. Specifically, our method achieves the best performance on the LIP and CIHP datasets and we also verify the generality of our method on the ADE20K dataset.

Multi-Class Human Body Parsing With Edge-Enhancement Network

Human Parsing with Edge Enhancement.

Toward Accurate Human Parsing Through Edge Guided Diffusion

Hybrid Resolution Network Using Edge Guided Region Mutual Information Loss for Human Parsing

GCAENet: Global-Class Context with Advanced Edge Network for Single Human Parsing

Attention-guided Progressive Partition Network for Human Parsing

BiEPNet: Bilateral Edge-perceiving Network for High-Resolution Human Parsing

Heterogeneous Interactive Attention Network for Human Parsing.

Channel and Spatial Enhancement Network for human parsing

Correlating Edge with Parsing for Human Parsing

Combining Parsing Information with Joint Structure for Human Pose Estimation.

Devil in the Details: Towards Accurate Single and Multiple Human Parsing

Multi-human Parsing with Pose and Boundary Guidance

Crowded Pose-Guided Multi-Task Learning for Instance-Level Human Parsing

Deep Human Parsing with Active Template Regression

Renovating Parsing R-CNN for Accurate Multiple Human Parsing

Classification Assisted Segmentation Network For Human Parsing

Explore Human Parsing Modality for Action Recognition

Single-stage Multi-human Parsing via Point Sets and Center-based Offsets

Weakly and Semi Supervised Human Body Part Parsing Via Pose-Guided Knowledge Transfer

Parsing Very High Resolution Urban Scene Images by Learning Deep ConvNets with Edge-Aware Loss