Abstract:The dominant backbones of neural networks for scene parsing consist of multiple stages, where feature maps in different stages often contain varying levels of spatial and semantic information. High-level features convey more semantics and fewer spatial details, while low-level features possess fewer semantics and more spatial details. Consequently, there are semantic-spatial gaps among features at different levels, particularly in human parsing tasks. Many existing approaches directly upsample multi-stage features and aggregate them through addition or concatenation, without addressing the semantic-spatial gaps present among these features. This inevitably leads to spatial misalignment, semantic mismatch, and ultimately misclassification in parsing, especially for human parsing that demands more semantic information and more fine details of feature maps for the reason of intricate textures, diverse clothing styles, and heavy scale variability across different human parts. In this paper, we effectively alleviate the long-standing challenge of addressing semantic-spatial gaps between features from different stages by innovatively utilizing the subtraction and addition operations to recognize the semantic and spatial differences and compensate for them. Based on these principles, we propose the Channel and Spatial Enhancement Network (CSENet) for parsing, offering a straightforward and intuitive solution for addressing semantic-spatial gaps via injecting high-semantic information to lower-stage features and vice versa, introducing fine details to higher-stage features. Extensive experiments on three dense prediction tasks have demonstrated the efficacy of our method. Specifically, our method achieves the best performance on the LIP and CIHP datasets and we also verify the generality of our method on the ADE20K dataset.

Pre- and In-Parsing Models for Neural Empty Category Detection.

The Covert Helps Parse the Overt

Two Local Models for Neural Constituent Parsing

Enlisting the Ghost: Modeling Empty Categories for Machine Translation

Error Detection for Text-to-SQL Semantic Parsing

Comparing Knowledge-Intensive and Data-Intensive Models for English Resource Semantic Parsing.

Improved Discourse Parsing with Two-Step Neural Transition-Based Model

Neural Network Models for Implicit Discourse Relation Classification in English and Chinese without Surface Features

A Bi-model based RNN Semantic Frame Parsing Model for Intent Detection and Slot Filling

Zero-Shot Dependency Parsing with Worst-Case Aware Automated Curriculum Learning

Neural Maximum Subgraph Parsing for Cross-Domain Semantic Dependency Analysis.

How to Plant Trees in Language Models: Data and Architectural Effects on the Emergence of Syntactic Inductive Biases

Discourse Representation Structure Parsing for Chinese

Unified Perceptual Parsing for Scene Understanding

Character-Level Chinese Dependency Parsing via Modeling Latent Intra-Word Structure

Is Supervised Syntactic Parsing Beneficial for Language Understanding? An Empirical Investigation

Semantic Parsing for English as a Second Language

Channel and Spatial Enhancement Network for human parsing

An Effective Neural Network Model for Graph-based Dependency Parsing.

Graph Pre-training for AMR Parsing and Generation

Predicting coarse-grained semantic features in language comprehension: evidence from ERP representational similarity analysis and Chinese classifier