Abstract:Labeling pixel-level masks for fine-grained semantic segmentation tasks, e.g., human parsing, remains a challenging task. The ambiguous boundary between different semantic parts and those categories with similar appearances are usually confusing for annotators, leading to incorrect labels in ground-truth masks. These label noises will inevitably harm the training process and decrease the performance of the learned models. To tackle this issue, we introduce a noise-tolerant method in this work, called Self-Correction for Human Parsing (SCHP), to progressively promote the reliability of the supervised labels as well as the learned models. In particular, starting from a model trained with inaccurate annotations as initialization, we design a cyclically learning scheduler to infer more reliable pseudo masks by iteratively aggregating the current learned model with the former sub-optimal one in an online manner. Besides, those correspondingly corrected labels can in turn to further boost the model performance. In this way, the models and the labels will reciprocally become more robust and accurate during the self-correction learning cycles. Our SCHP is model-agnostic and can be applied to any human parsing models for further enhancing their performance. Extensive experiments on four human parsing models, including Deeplab V3+, CE2P, OCR and CE2P+, well demonstrate the effectiveness of the proposed SCHP. We achieve the new state-of-the-art results on 6 benchmarks, including LIP, Pascal-Person-Part and ATR for single human parsing, CIHP and MHP for multi-person human parsing and VIP for video human parsing tasks. In addition, benefiting the superiority of SCHP, we achieved the 1st place on all the three human parsing tracks in the 3rd Look Into Person Challenge. The code is available at https://github.com/PeikeLi/Self-Correction-Human-Parsing.

Part Decomposition and Refinement Network for Human Parsing

Discriminative Hierarchical Part-Based Models for Human Parsing and Action Recognition.

Learning hierarchical poselets for human parsing

Pose-Guided Hierarchical Semantic Decomposition and Composition for Human Parsing

Body-Boundary-Refined Human Parsing Network Based on Fully Convolutional Network and Conditional Random Fields

Toward Accurate Human Parsing Through Edge Guided Diffusion

Attention-guided Progressive Partition Network for Human Parsing

Improving Human Parsing by Extracting Global Information Using the Non-Local Operation

Learning Semantic Neural Tree for Human Parsing

Hierarchical Human Semantic Parsing With Comprehensive Part-Relation Modeling

Deep Hierarchical Human Semantic Parsing

Hybrid Resolution Network Using Edge Guided Region Mutual Information Loss for Human Parsing

From Simple to Complex Scenes: Learning Robust Feature Representations for Accurate Human Parsing

Instance-level Human Parsing Via Part Grouping Network.

Human Parsing with Edge Enhancement.

Hierarchical Human Parsing with Typed Part-Relation Reasoning

Self-Correction for Human Parsing

Pose-Guided Human Parsing with Deep Learned Features

Finer-Net: Cascaded Human Parsing with Hierarchical Granularity

SNNet: Specific Node Network of Human Parsing

ReSParser: Fully Convolutional Multiple Human Parsing with Representative Sets