Abstract:Weakly supervised object detection (WSOD) has attracted attention increasingly in object detection, as it only requires image-level annotations to train the detector. A typical paradigm for WSOD is to first generate candidate region proposals for the training data, and then each image is treated as a bag of proposals to conduct the training based on the multiple instance learning (MIL). Most methods focus on optimizing the training process, but rarely consider the influence of pre-generated proposals that directly affect the learning of the detector, due to the overwhelming noisy proposals (e.g., negative or background proposals) and positive proposals with inaccurate locations. In this paper, we focus on improving the quality of proposals, and propose a recurrent self-optimizing proposal framework, a new paradigm for WSOD, to iteratively optimize the pre-generated proposals. In each iteration, all detection results (i.e., the object-aware coordinate offsets and the confidence scores) are accumulated for proposal optimization. To achieve accurate object location, we design a proposal self-transformation module to transform the locations of pre-generated proposals based on the coordinate offsets. To alleviate the impact of noise proposals, we design a proposal self-sampling module to mine object instances through confidence scores to filter out noisy proposals. Furthermore, these optimized proposals are fed into a decoupled proposal learner, which contains two parallel proposal training branches. A MIL module and an instance refinement module are supervised by the image label and the mined object instances, respectively. In addition, the instance refinement module contains an instance regression refinement module, which is proposed to generate object-aware coordinate offsets. In turn, the decoupled proposal learner produces the new detection results to optimize proposals in the next iteration. Extensive experiments on PASCAL VOC and MS-COCO datasets demonstrate the effectiveness of our method.

FI-WSOD: Foreground Information Guided Weakly Supervised Object Detection

Spatial Likelihood Voting with Self-Knowledge Distillation for Weakly Supervised Object Detection.

SLV: Spatial Likelihood Voting for Weakly Supervised Object Detection

Foreground Gating and Background Refining Network for Surveillance Object Detection

Weakly Supervised Foreground Learning for Weakly Supervised Localization and Detection

Self-Training-Based Semantic-Balanced Network for Weakly Supervised Object Detection in Remote-Sensing Images

Cyclic Self-Training With Proposal Weight Modulation for Cross-Supervised Object Detection

Weakly Supervised Few-Shot Object Detection with DETR

MOL: Towards Accurate Weakly Supervised Remote Sensing Object Detection Via Multi-view Noisy Learning

HUWSOD: Holistic Self-training for Unified Weakly Supervised Object Detection

Weakly Supervised Object Detection for Remote Sensing Images via Progressive Image-Level and Instance-Level Feature Refinement

Refining and reweighting pseudo labels for weakly supervised object detection

Instance Mining with Class Feature Banks for Weakly Supervised Object Detection.

High-Quality Proposals for Weakly Supervised Object Detection.

Weakly Supervised Open-Vocabulary Object Detection

Few-shot Weakly-Supervised Object Detection via Directional Statistics

Recurrent Self-Optimizing Proposals for Weakly Supervised Object Detection

WSODPB: Weakly Supervised Object Detection with PCSNet and Box Regression Module.

Foreground separation knowledge distillation for object detection

Fine-grained Background Representation for Weakly Supervised Semantic Segmentation

Cyclic-Bootstrap Labeling for Weakly Supervised Object Detection