Abstract:Object attention maps generated by image classifiers are usually used as priors for weakly supervised semantic segmentation. However, attention maps usually locate the most discriminative object parts. The lack of integral object localization maps heavily limits the performance of weakly supervised segmentation approaches. This paper attempts to investigate a novel way to identify entire object regions in a weakly supervised manner. We observe that image classifiers' attention maps at different training phases may focus on different parts of the target objects. Based on this observation, we propose an online attention accumulation (OAA) strategy that utilizes the attention maps at different training phases to obtain more integral object regions. Specifically, we maintain a cumulative attention map for each target category in each training image and utilize it to record the discovered object regions at different training phases. Albeit OAA can effectively mine more object regions for most images, for some training images, the range of the attention movement is not large, limiting the generation of integral object attention regions. To overcome this problem, we propose incorporating an attention drop layer into the online attention accumulation process to enlarge the range of attention movement during training explicitly. Our method (OAA) can be plugged into any classification network and progressively accumulate the discriminative regions into cumulative attention maps as the training process goes. Additionally, we also explore utilizing the final cumulative attention maps to serve as the pixel-level supervision, which can further assist the network in discovering more integral object regions. When applying the resulting attention maps to the weakly supervised semantic segmentation task, our approach improves the existing state-of-the-art methods on the PASCAL VOC 2012 segmentation benchmark, achieving a mIoU score of 67.2 percent on the test set.

Partial Class Activation Attention for Semantic Segmentation

Gradient-coupled Cross-Patch Attention Map for Weakly Supervised Semantic Segmentation

Attention-based Class Activation Diffusion for Weakly-Supervised Semantic Segmentation

CAA : Channelized Axial Attention for Semantic Segmentation.

Channelized Axial Attention for Semantic Segmentation -- Considering Channel Relation within Spatial Attention for Semantic Segmentation

Attention Based Object Localization for Weakly Supervised Semantic Segmentation

Online Attention Accumulation for Weakly Supervised Semantic Segmentation

DCAM: Disturbed Class Activation Maps for Weakly Supervised Semantic Segmentation

Extracting Class Activation Maps from Non-Discriminative Features as well

Activation Modulation and Recalibration Scheme for Weakly Supervised Semantic Segmentation

Embedded Discriminative Attention Mechanism for Weakly Supervised Semantic Segmentation

Fully Attentional Network for Semantic Segmentation

Adaptive Activation Network for Weakly Supervised Semantic Segmentation

Self-Supervised Equivariant Attention Mechanism for Weakly Supervised Semantic Segmentation

SemSegFPA: Semantic Segmentation Feature Pyramid Network with Attention Module

An Efficient Sampling-Based Attention Network for Semantic Segmentation

Class Re-Activation Maps for Weakly-Supervised Semantic Segmentation

Exploit CAM by Itself: Complementary Learning System for Weakly Supervised Semantic Segmentation

Mixed High-Order Attention Network for Weakly- Supervised Semantic Segmentation

Exploit CAM by itself: Complementary Learning System for Weakly Supervised Semantic Segmentation

Semantic Segmentation Algorithm Based on Class Feature Attention Mechanism Fusion