Abstract:Semantic segmentation is a fundamental problem in multimedia which requires delicate per-pixel predictions of object categories. Recently, many researchers strive to refine the pixel-wise feature with spatial -contextual information. However, many of them still neglect the invisible hand of cross- channel information which provides inherent semantics to facilitate the segmentation performance. On the one hand, in the feature extraction stage, enhancing informative channels and suppressing trivial ones contribute to the acquisition of valuable semantic features, and thus improving the segmentation accuracy. On the other hand, in the prediction stage, we can predict the complete objects more clearly by finding the connections and complements between different channels, which can also contribute to the pixel prediction. And based on this idea, we propose a novel Channel-Adaptive Network for semantic segmentation, which is capable of enhancing the features from the perspective of channels in both feature extraction stage and prediction stage. Specifically, we propose two modules: (i) the Comprehensive Information Channel Attention (CiCA) module that addresses the shortcomings of existing channel attention by learning both low and high frequency components within each channel for emphasizing the informative channels; (ii) the Inter-Channel Relationship Reasoning (iCRR) module which is applied on the top of the feature extractor to adaptively enhance the interdependent channels by mining the complementary associations between them. Besides, our Channel-Adaptive Network is highly flexible, with a plug-and-play design. Extensive experiments have demonstrated that our method achieves the state-of-the-art segmentation performance on three challenging datasets, including Cityscapes (82.1%), ADE20K (46.51%) and PASCAL Context (55.0%).

A Gesture Segmentation Method Based on Domain Adaptation and Channel Attention Mechanism

A Channel-Wise Spatial-Temporal Aggregation Network for Action Recognition

Learning Cross-Channel Representations for Semantic Segmentation

CAA : Channelized Axial Attention for Semantic Segmentation.

Edge-Enhanced GCIFFNet: A Multiclass Semantic Segmentation Network Based on Edge Enhancement and Multiscale Attention Mechanism

Adaptive Local Cross-Channel Vector Pooling Attention Module for Semantic Segmentation of Remote Sensing Imagery

DPANET:Dual Pooling Attention Network for Semantic Segmentation

Channelized Axial Attention for Semantic Segmentation -- Considering Channel Relation within Spatial Attention for Semantic Segmentation

Attention Guided Global Enhancement and Local Refinement Network for Semantic Segmentation

FcaNet: Frequency Channel Attention Networks

Global domain adaptation attention with data-dependent regulator for scene segmentation

GADA-SegNet: gated attentive domain adaptation network for semantic segmentation of LiDAR point clouds

Stochastic Region Pooling: Make Attention More Expressive

PPNet : Pooling Position Attention Network for Semantic Segmentation

Lightweight Attention Network for Very High-Resolution Image Semantic Segmentation

Realtime Global Attention Network for Semantic Segmentation

Cascaded Attention Guided Network for Retinal Vessel Segmentation.

Hybrid Multiple Attention Network for Semantic Segmentation in Aerial Images

An Improved Gesture Segmentation Method for Gesture Recognition Based on CNN and YCbCr

CGGLNet: Semantic Segmentation Network for Remote Sensing Images Based on Category-Guided Global–Local Feature Interaction

Improving Semantic Segmentation of Aerial Images Using Patch-based Attention