Abstract:Weakly supervised object localization (WSOL) aims to train instance-level locators by exploiting accessible image-level labels. By multiplying channel-wise features with classification weights and then adding them together, most prior works follow the pipeline of the Class Activation Map (CAM) to collect the semantic responses, thereby highlighting regions that contribute to class prediction to achieve WSOL. However, CAM-based methods treat the class contributions of all pixel positions in a channel equally and assign dominant weights for the discriminative channels biasedly. This fails to express the fine-grained pixel-level semantic response of each channel and model the complex contextual relations between channels, resulting in the mixup of the activation value between non-discriminative foreground regions and the background. To alleviate these issues, we present a Local Semantic activation enhancement and Global Spatial correlation mining network (LSGS-Net) for accurate WSOL. Specifically, we first propose a local activation generation module to explicitly learn the semantic response of each pixel position from channels. Then, we design a regularization loss to supervise the consistency between similar local activations, which utilizes the cross-image information to improve the accuracy of local activations. We further propose a K-nearest Neighbors graph module to capture the spatial correlation between different local activations, which can adaptively assign more proper weights when fusing all local activation. In the inference stage, the bounding box will be determined with a foreground threshold. Extensive experiments show that LSGS-Net achieves significant and consistent improvement with various backbones on the CUB, ILSVRC, and OpenImages benchmarks, with a 97.5% and 75.3% GT-Known LOC on CUB and ILSVRC, respectively. For segmentation quality on OpenImages, LSGS-Net already exceeds the SOTA method by 1.2% pIoU and 1.9% PxAP.

Learning Local Features by Jointly Semantic-guided and Task Rewards

Joint CRF and Locality-Consistent Dictionary Learning for Semantic Segmentation.

Learning Semantic-Aware Local Features for Long Term Visual Localization

SADGFeat: Learning Local Features with Layer Spatial Attention and Domain Generalization

Associate Semantic-Instance Segmentation of 3D Point Clouds Based on Local Feature Extraction

Segment Anything Model is a Good Teacher for Local Feature Learning

Learning Local Features with Context Aggregation for Visual Localization

Shared Coupling-Bridge Scheme for Weakly Supervised Local Feature Learning

SemFE:A Feature Matching Method for Learnable Local Semantic Feature Enhancement in Multimodal Images

Learning Semantic Alignment Using Global Features and Multi-scale Confidence

Shared Coupling-bridge for Weakly Supervised Local Feature Learning

Local-to-Global Semantic Learning for Multi-View 3D Object Detection from Point Cloud

Joint Learning of Semantic Alignment and Object Landmark Detection

Learning a Discriminative Feature Network for Semantic Segmentation

A Large-Scale Point Cloud Semantic Segmentation Network Via Local Dual Features and Global Correlations

Object and spatial discrimination makes weakly supervised local feature better

Semantic-Aware Fine-Grained Correspondence

Deep Joint Task Learning for Generic Object Extraction.

HDMapNet: A Local Semantic Map Learning and Evaluation Framework.

Learning Local Semantic Region Activations for Weakly Supervised Object Localization

Semi-supervised Semantic Segmentation Meets Masked Modeling:Fine-grained Locality Learning Matters in Consistency Regularization