Abstract:Weakly supervised object localization (WSOL) aims to train instance-level locators by exploiting accessible image-level labels. By multiplying channel-wise features with classification weights and then adding them together, most prior works follow the pipeline of the Class Activation Map (CAM) to collect the semantic responses, thereby highlighting regions that contribute to class prediction to achieve WSOL. However, CAM-based methods treat the class contributions of all pixel positions in a channel equally and assign dominant weights for the discriminative channels biasedly. This fails to express the fine-grained pixel-level semantic response of each channel and model the complex contextual relations between channels, resulting in the mixup of the activation value between non-discriminative foreground regions and the background. To alleviate these issues, we present a Local Semantic activation enhancement and Global Spatial correlation mining network (LSGS-Net) for accurate WSOL. Specifically, we first propose a local activation generation module to explicitly learn the semantic response of each pixel position from channels. Then, we design a regularization loss to supervise the consistency between similar local activations, which utilizes the cross-image information to improve the accuracy of local activations. We further propose a K-nearest Neighbors graph module to capture the spatial correlation between different local activations, which can adaptively assign more proper weights when fusing all local activation. In the inference stage, the bounding box will be determined with a foreground threshold. Extensive experiments show that LSGS-Net achieves significant and consistent improvement with various backbones on the CUB, ILSVRC, and OpenImages benchmarks, with a 97.5% and 75.3% GT-Known LOC on CUB and ILSVRC, respectively. For segmentation quality on OpenImages, LSGS-Net already exceeds the SOTA method by 1.2% pIoU and 1.9% PxAP.

Large-scale sparse learning from noisy tags for semantic segmentation

Large-Scale Sparse Learning from Noisy Tags for Semantic Segmentation.

Learning from Weak and Noisy Labels for Semantic Segmentation.

Weakly Supervised Semantic Segmentation with a Multiscale Model

Noise-Robust Semi-Supervised Learning by Large-Scale Sparse Coding.

Simple and Efficient: A Semisupervised Learning Framework for Remote Sensing Image Semantic Segmentation

Sparse Reconstruction for Weakly Supervised Semantic Segmentation.

L2A: Learning Affinity from Attention for Weakly Supervised Continual Semantic Segmentation

Semantic context learning with large-scale weakly-labeled image set.

Learning Local Semantic Region Activations for Weakly Supervised Object Localization

Weakly Supervised Semantic Segmentation for Social Images

Large-scale Unsupervised Semantic Segmentation

Can Image-Level Labels Replace Pixel-Level Labels for Image Parsing.

Weakly Supervised Semantic Segmentation for Large-Scale Point Cloud

Weakly-Supervised Semantic Segmentation with Visual Words Learning and Hybrid Pooling

LMSeg: Unleashing the Power of Large-Scale Models for Open-Vocabulary Semantic Segmentation

Learning Self-supervised Low-Rank Network for Single-Stage Weakly and Semi-supervised Semantic Segmentation

Group-Wise Semantic Mining for Weakly Supervised Semantic Segmentation

Remote Sensing Image Segmentation Using Local Sparse Structure Constrainted Latent Low Rank Representation

Looking Beyond Single Images for Weakly Supervised Semantic Segmentation Learning.

Weakly-supervised Semantic Segmentation via Dual-stream Contrastive Learning of Cross-image Contextual Information