Abstract:The dominant backbones of neural networks for scene parsing consist of multiple stages, where feature maps in different stages often contain varying levels of spatial and semantic information. High-level features convey more semantics and fewer spatial details, while low-level features possess fewer semantics and more spatial details. Consequently, there are semantic-spatial gaps among features at different levels, particularly in human parsing tasks. Many existing approaches directly upsample multi-stage features and aggregate them through addition or concatenation, without addressing the semantic-spatial gaps present among these features. This inevitably leads to spatial misalignment, semantic mismatch, and ultimately misclassification in parsing, especially for human parsing that demands more semantic information and more fine details of feature maps for the reason of intricate textures, diverse clothing styles, and heavy scale variability across different human parts. In this paper, we effectively alleviate the long-standing challenge of addressing semantic-spatial gaps between features from different stages by innovatively utilizing the subtraction and addition operations to recognize the semantic and spatial differences and compensate for them. Based on these principles, we propose the Channel and Spatial Enhancement Network (CSENet) for parsing, offering a straightforward and intuitive solution for addressing semantic-spatial gaps via injecting high-semantic information to lower-stage features and vice versa, introducing fine details to higher-stage features. Extensive experiments on three dense prediction tasks have demonstrated the efficacy of our method. Specifically, our method achieves the best performance on the LIP and CIHP datasets and we also verify the generality of our method on the ADE20K dataset.

Character-Level Feature Extraction with Densely Connected Networks

Improving Feature Extraction Using a Hybrid of CNN and LSTM for Entity Identification

Character-level Convolutional Networks for Text Classification

Dense Residual Network: Enhancing global dense feature flow for character recognition

A Local Information Perception Enhancement–Based Method for Chinese NER

Named Entity Recognition with Bidirectional LSTM-CNNs

Empirical Study on Character Level Neural Network Classifier for Chinese Text.

Event Extraction Via Dynamic Multi-Pooling Convolutional Neural Networks.

A neuralized feature engineering method for entity relation extraction

A Character-Level Method for Text Classification

FLEPNet: Feature Level Ensemble Parallel Network for Facial Expression Recognition

Deep Converged Network for Attention

An Image Classification Method Based on Adaptive Attention Mechanism and Feature Extraction Network

Channel and Spatial Enhancement Network for human parsing

Target Extraction via Feature-Enriched Neural Networks Model

Constrained Learned Feature Extraction for Acoustic Scene Classification

Character-level Neural Networks for Short Text Classification

FER-Net: Facial Expression Recognition Using Densely Connected Convolutional Network

A Novel Approach for Character Feature Extraction and Recognition Based on RBF Neural Network

Characters as Graphs: Recognizing Online Handwritten Chinese Characters via Spatial Graph Convolutional Network

A Convolution BiLSTM Neural Network Model for Chinese Event Extraction