Abstract:Semantic segmentation is a fundamental problem in multimedia which requires delicate per-pixel predictions of object categories. Recently, many researchers strive to refine the pixel-wise feature with spatial -contextual information. However, many of them still neglect the invisible hand of cross- channel information which provides inherent semantics to facilitate the segmentation performance. On the one hand, in the feature extraction stage, enhancing informative channels and suppressing trivial ones contribute to the acquisition of valuable semantic features, and thus improving the segmentation accuracy. On the other hand, in the prediction stage, we can predict the complete objects more clearly by finding the connections and complements between different channels, which can also contribute to the pixel prediction. And based on this idea, we propose a novel Channel-Adaptive Network for semantic segmentation, which is capable of enhancing the features from the perspective of channels in both feature extraction stage and prediction stage. Specifically, we propose two modules: (i) the Comprehensive Information Channel Attention (CiCA) module that addresses the shortcomings of existing channel attention by learning both low and high frequency components within each channel for emphasizing the informative channels; (ii) the Inter-Channel Relationship Reasoning (iCRR) module which is applied on the top of the feature extractor to adaptively enhance the interdependent channels by mining the complementary associations between them. Besides, our Channel-Adaptive Network is highly flexible, with a plug-and-play design. Extensive experiments have demonstrated that our method achieves the state-of-the-art segmentation performance on three challenging datasets, including Cityscapes (82.1%), ADE20K (46.51%) and PASCAL Context (55.0%).

Cross Aggregation Network for Semantic Segmentation

Multi-Scale Feature Aggregation by Cross-Scale Pixel-to-Region Relation Operation for Semantic Segmentation

Attention-guided chained context aggregation for semantic segmentation

Cross Guided and Pyramid Aggregation Networks for Real-time Semantic Segmentation

Learning Cross-Channel Representations for Semantic Segmentation

Muti-Scale Context-Aware Network for Cross-Domain Unsupervised Remote Sensing Image Semantic Segmentation

Aggregating Multi-Scale Contextual Features from Multiple Stages for Semantic Image Segmentation

Cross-CBAM: A Lightweight network for Scene Segmentation

Context Aggregation Network for Remote Sensing Image Semantic Segmentation

CCNet: Criss-Cross Attention for Semantic Segmentation

Multi-Scale Context Aggregation for Semantic Segmentation of Remote Sensing Images.

Cross-Scale Feature Propagation Network for Semantic Segmentation of High-Resolution Remote Sensing Images

CCANet: Cross-Modality Comprehensive Feature Aggregation Network for Indoor Scene Semantic Segmentation

Cross-CBAM: a lightweight network for real-time scene segmentation

Multi-stage Context Refinement Network for Semantic Segmentation

Aggregation Architecture and All-to-one Network for Real-Time Semantic Segmentation

Learning Deep Cross-Scale Feature Propagation for Indoor Semantic Segmentation

Cross Attention Network For Semantic Segmentation

Context and Apparent Features Aggregation Network for Semantic Segmentation

Real-time Semantic Segmentation with Context Aggregation Network