Abstract:Weakly-supervised learning has emerged as a compelling method for object detection by reducing the fully annotated labels requirement in the training procedure. Recently, some works have treated the detection task as a classification task, resulting in highlighting only discriminative object parts. Moreover, fully-supervised object detectors use specific modules (e.g. feature pyramid networks (FPN) and region proposal network (RPN)) to accurately localize target objects, while weakly-supervised object detectors, such as a well-designed module for object localization, rarely exist. To address the above challenges and gaps, we propose a region-aware continual contrastive fusion (R-CCF) module, which can be plugged into any off-the-shelf weak detector to improve detection performance by refining object location. Specifically, a novel region association (RA) algorithm is proposed to automatically query similarities of the most discriminative regions with their surrounding regions and then to form new rough object locations. Furthermore, we introduce an effective object integration (OI) constraint, including a class sub-constraint and a distance sub-constraint, to refine the rough object locations from the RA algorithm further and achieve accurate object regions. By integrating our R-CCF module into weakly supervised detector architectures and training end-to-end, we can continually refine object locations by contrastively fusing the discriminative regions with surrounding patches. Extensive experiments demonstrate the effectiveness of the proposed method in weakly supervised object detection and show that integrating R-CCF into the state-of-the-art MIST [ 1 ] achieves 58.3% in mAP on the PASCAL VOC2007 benchmark, surpassing MIST by 0.2% absolutely. Moreover, R-CCF based on OICR [ 2 ] and WSDDN [ 3 ] achieve 42.5% and 32.5% in mAP on the PASCAL VOC2007, which is 1.3% and 2.1% higher than the baseline detectors, respectively. We also test the robustness of R-CCF on the PASCAL VOC 2012 dataset, and R-CCF outperforms the baseline methods clearly.

How Context Helps: A Discriminative Codeword Selection Method for Object Detection

Object Recognition Based on the Region of Interest and Optimal Bag of Words Model.

Spatial Likelihood Voting with Self-Knowledge Distillation for Weakly Supervised Object Detection.

Context Refinement for Object Detection

Contextual Object Detection with Spatial Context Prototypes

What Makes Good Open-Vocabulary Detector: A Disassembling Perspective

Object Retrieval Using Visual Query Context

Discovering spatial context prototypes for object detection

Deep feature based contextual model for object detection

Simple Image-level Classification Improves Open-vocabulary Object Detection

High-Quality Proposals for Weakly Supervised Object Detection.

ContextHOI: Spatial Context Learning for Human-Object Interaction Detection

R-CCF: region-aware continual contrastive fusion for weakly supervised object detection

Hierarchical Context Embedding for Region-based Object Detection.

Exploring Multi-Modal Contextual Knowledge for Open-Vocabulary Object Detection

Task-Specific Context Decoupling for Object Detection

Optimizing Region Selection for Weakly Supervised Object Detection

Weakly Supervised Object Detection with Symmetry Context

Contextual Object Detection with Multimodal Large Language Models

Object-Part Attention Driven Discriminative Localization for Fine-grained Image Classification.

Discriminative Codeword Selection for Image Representation.