Abstract:Semantic segmentation is a fundamental problem in multimedia which requires delicate per-pixel predictions of object categories. Recently, many researchers strive to refine the pixel-wise feature with spatial -contextual information. However, many of them still neglect the invisible hand of cross- channel information which provides inherent semantics to facilitate the segmentation performance. On the one hand, in the feature extraction stage, enhancing informative channels and suppressing trivial ones contribute to the acquisition of valuable semantic features, and thus improving the segmentation accuracy. On the other hand, in the prediction stage, we can predict the complete objects more clearly by finding the connections and complements between different channels, which can also contribute to the pixel prediction. And based on this idea, we propose a novel Channel-Adaptive Network for semantic segmentation, which is capable of enhancing the features from the perspective of channels in both feature extraction stage and prediction stage. Specifically, we propose two modules: (i) the Comprehensive Information Channel Attention (CiCA) module that addresses the shortcomings of existing channel attention by learning both low and high frequency components within each channel for emphasizing the informative channels; (ii) the Inter-Channel Relationship Reasoning (iCRR) module which is applied on the top of the feature extractor to adaptively enhance the interdependent channels by mining the complementary associations between them. Besides, our Channel-Adaptive Network is highly flexible, with a plug-and-play design. Extensive experiments have demonstrated that our method achieves the state-of-the-art segmentation performance on three challenging datasets, including Cityscapes (82.1%), ADE20K (46.51%) and PASCAL Context (55.0%).

Channel and Spatial Enhancement Network for human parsing

HSNet: Hierarchical Semantics Network for Scene Parsing

Toward Achieving Robust Low-Level and High-Level Scene Parsing

Attention-guided Progressive Partition Network for Human Parsing

Multi-layer Feature Aggregation for Deep Scene Parsing Models

MoE-SPNet: A Mixture-of-experts Scene Parsing Network.

From Simple to Complex Scenes: Learning Robust Feature Representations for Accurate Human Parsing

Class Semantic Enhancement Network for Semantic Segmentation

Quality-Aware Network for Human Parsing

Multi-Class Human Body Parsing With Edge-Enhancement Network

Fast and Accurate Scene Parsing Via Bi-direction Alignment Networks

CASINet: Content-Adaptive Scale Interaction Networks for Scene Parsing

CaseNet: Content-Adaptive Scale Interaction Networks for Scene Parsing

Consensus Feature Network for Scene Parsing

Neural Architecture Search for Joint Human Parsing and Pose Estimation

AttaNet: Attention-Augmented Network for Fast and Accurate Scene Parsing

Toward Accurate Human Parsing Through Edge Guided Diffusion

Learning Cross-Channel Representations for Semantic Segmentation

EKENet: Efficient knowledge enhanced network for real-time scene parsing

Attention Guided Global Enhancement and Local Refinement Network for Semantic Segmentation

EFRNet: Efficient Feature Reconstructing Network for Real-Time Scene Parsing