Abstract:Image-level annotations allow to achieve semantic segmentation in a weakly-supervised way. Most advanced approaches utilize class activation map (CAM) from deep classifier to generate pseudo-labels. However, CAM generally only focuses on the most discriminative parts of targets. To explore more pixel-level semantic information and recognize all pixels within the objects for segmentation, we propose a Region-based Pixels Integration Mechanism (RPIM) which discovers the intra-region and inter-region information. Firstly, the foreground regions are formed on the basis of superpixels and the initial responses. Each region is regarded as a subtree, whose nodes are the image pixels within the region. Then, an Intra-region Integration (IRI) Module is designed to explore the nodes relationships inside the subtree. Within each subtree, nodes will vote for the most confident class and share the highest probability. Moreover, an Inter-region Spreading (IRS) Module is proposed to further improve the consistency of CAM. For each class, the most confident unprocessed subtree finds their homologous neighbors, connects with them and shares its probability. By iterative refinement, the training process will integrate the individual nodes into region subtrees, and gradually form the subtrees with similar probabilities to the object semantic trees for each foreground class. To our best knowledge, our approach achieves the state-of-the-art performance on PASCAL VOC 2012 validation set with 71.4% mIoU. The experiments also show that our scheme is plug-and-play and can collaborate with different approaches to improve their performance.

Area Intervention for Enhancing Class Activation Maps in Weakly Supervised Semantic Segmentation

DCAM: Disturbed Class Activation Maps for Weakly Supervised Semantic Segmentation

Extracting Class Activation Maps from Non-Discriminative Features as well

Activation Modulation and Recalibration Scheme for Weakly Supervised Semantic Segmentation

Class Re-Activation Maps for Weakly-Supervised Semantic Segmentation

Attention-based Class Activation Diffusion for Weakly-Supervised Semantic Segmentation

Rethinking CAM in Weakly-Supervised Semantic Segmentation

Exploit CAM by itself: Complementary Learning System for Weakly Supervised Semantic Segmentation

Exploit CAM by Itself: Complementary Learning System for Weakly Supervised Semantic Segmentation

Wave-Like Class Activation Map with Representation Fusion for Weakly-Supervised Semantic Segmentation

Adaptive Activation Network for Weakly Supervised Semantic Segmentation

Spatial Structure Constraints for Weakly Supervised Semantic Segmentation

Non-target Feature Filtering for Weakly Supervised Semantic Segmentation

Activation extending based on long-range dependencies for weakly supervised semantic segmentation

Erase then Grow: Generating Correct Class Activation Maps for Weakly-Supervised Semantic Segmentation

Attention Based Object Localization for Weakly Supervised Semantic Segmentation

Embedded Discriminative Attention Mechanism for Weakly Supervised Semantic Segmentation

Weakly Supervised Semantic Segmentation with Patch-Based Metric Learning Enhancement

Weakly Supervised Semantic Segmentation by Pixel-to-Prototype Contrast

Region-based Pixels Integration Mechanism Forweakly Supervised Semantic Segmentation

Joint Image Restoration for Weakly Supervised Semantic Segmentation