Abstract:Semantic segmentation is a fundamental problem in multimedia which requires delicate per-pixel predictions of object categories. Recently, many researchers strive to refine the pixel-wise feature with spatial -contextual information. However, many of them still neglect the invisible hand of cross- channel information which provides inherent semantics to facilitate the segmentation performance. On the one hand, in the feature extraction stage, enhancing informative channels and suppressing trivial ones contribute to the acquisition of valuable semantic features, and thus improving the segmentation accuracy. On the other hand, in the prediction stage, we can predict the complete objects more clearly by finding the connections and complements between different channels, which can also contribute to the pixel prediction. And based on this idea, we propose a novel Channel-Adaptive Network for semantic segmentation, which is capable of enhancing the features from the perspective of channels in both feature extraction stage and prediction stage. Specifically, we propose two modules: (i) the Comprehensive Information Channel Attention (CiCA) module that addresses the shortcomings of existing channel attention by learning both low and high frequency components within each channel for emphasizing the informative channels; (ii) the Inter-Channel Relationship Reasoning (iCRR) module which is applied on the top of the feature extractor to adaptively enhance the interdependent channels by mining the complementary associations between them. Besides, our Channel-Adaptive Network is highly flexible, with a plug-and-play design. Extensive experiments have demonstrated that our method achieves the state-of-the-art segmentation performance on three challenging datasets, including Cityscapes (82.1%), ADE20K (46.51%) and PASCAL Context (55.0%).

Locally Shared Features: an Efficient Alternative to Conditional Random Field for Semantic Segmentation

CRF with Locality-Consistent Dictionary Learning for Semantic Segmentation

Joint CRF and Locality-Consistent Dictionary Learning for Semantic Segmentation.

Improving Semantic Image Segmentation with a Probabilistic Superpixel-Based Dense Conditional Random Field.

Scene Segmentation with Low-Dimensional Semantic Representations and Conditional Random Fields

An Improved Image Semantic Segmentation Method Based on Superpixels and Conditional Random Fields

Image semantic segmentation based on FCN-CRF model

CRF Learning with CNN Features for Image Segmentation

A Semantic Segmentation Algorithm Using FCN with Combination of BSLIC

FC-RCCN: Fully Convolutional Residual Continuous CRF Network for Semantic Segmentation

Image Segmentation Based on Semantic Knowledge and Hierarchical Conditional Random Fields

ES-CRF: Embedded Superpixel CRF for Semantic Segmentation.

LRFNet: An Occlusion Robust Fusion Network for Semantic Segmentation with Light Field

Image Semantic Segmentation Optimization by Conditional Random Field Integrated with Object Clique Potential.

Convolutional CRFs for Semantic Segmentation

A Local-Global Feature Fusing Method for Point Clouds Semantic Segmentation

Efficient Object Region Discovery for Weakly-supervised Semantic Segmentation

SDFCNv2: An Improved FCN Framework for Remote Sensing Images Semantic Segmentation

Object Region Segmentation Using Deep Features and Pixel Modeling by Conditional Random Fields

Learning Cross-Channel Representations for Semantic Segmentation

Better Image Segmentation by Exploiting Dense Semantic Predictions