Abstract:Weakly-supervised learning has emerged as a compelling method for object detection by reducing the fully annotated labels requirement in the training procedure. Recently, some works have treated the detection task as a classification task, resulting in highlighting only discriminative object parts. Moreover, fully-supervised object detectors use specific modules (e.g. feature pyramid networks (FPN) and region proposal network (RPN)) to accurately localize target objects, while weakly-supervised object detectors, such as a well-designed module for object localization, rarely exist. To address the above challenges and gaps, we propose a region-aware continual contrastive fusion (R-CCF) module, which can be plugged into any off-the-shelf weak detector to improve detection performance by refining object location. Specifically, a novel region association (RA) algorithm is proposed to automatically query similarities of the most discriminative regions with their surrounding regions and then to form new rough object locations. Furthermore, we introduce an effective object integration (OI) constraint, including a class sub-constraint and a distance sub-constraint, to refine the rough object locations from the RA algorithm further and achieve accurate object regions. By integrating our R-CCF module into weakly supervised detector architectures and training end-to-end, we can continually refine object locations by contrastively fusing the discriminative regions with surrounding patches. Extensive experiments demonstrate the effectiveness of the proposed method in weakly supervised object detection and show that integrating R-CCF into the state-of-the-art MIST [ 1 ] achieves 58.3% in mAP on the PASCAL VOC2007 benchmark, surpassing MIST by 0.2% absolutely. Moreover, R-CCF based on OICR [ 2 ] and WSDDN [ 3 ] achieve 42.5% and 32.5% in mAP on the PASCAL VOC2007, which is 1.3% and 2.1% higher than the baseline detectors, respectively. We also test the robustness of R-CCF on the PASCAL VOC 2012 dataset, and R-CCF outperforms the baseline methods clearly.

Feature Fusion for Weakly Supervised Object Localization

Hierarchical Saliency Mapping for Weakly Supervised Object Localization Based on Class Activation Mapping

ObjectFusion: an Object Detection and Segmentation Framework with RGB-D SLAM and Convolutional Neural Networks

Weakly-supervised object localization with gradient-pyramid feature

Object Localization Based on Proposal Fusion.

Attention-based Fusion Factor in FPN for Object Detection

CSCP-Net - Cuboid-Shaped Child-Pyramid Augmentation.

Multi-scale feature selection and fusion for object detection

Multi-scale discriminative Region Discovery for Weakly-Supervised Object Localization

Adaptive Learning Feature Pyramid for Object Detection

AugFPN: Improving Multi-Scale Feature Learning for Object Detection.

Scalable Object Detection Using Deep But Lightweight Cnn With Features Fusion

Improve Object Detection Via a Multi-Feature and Multi-Task CNN Model

Feature Fusion Use Unsupervised Prior Knowledge to Let Small Object Represent

Object Detection Based on Feature Scale Fusion and Feature Scale Enhancement.

Multi-scale Fusion with Context-aware Network for Object Detection

R-CCF: region-aware continual contrastive fusion for weakly supervised object detection

Content-Augmented Feature Pyramid Network with Light Linear Spatial Transformers for Object Detection

Exploring Multi-scale Deep Feature Fusion for Object Detection.

Multi-level Feature Fusion Pyramid Network for Object Detection

Inter-Image Communication for Weakly Supervised Localization