Abstract:Open-vocabulary object detection (OVOD) aims at localizing and recognizing visual objects from novel classes unseen at the training time. Whereas, empirical studies reveal that advanced detectors generally assign lower scores to those novel instances, which are inadvertently suppressed during inference by commonly adopted greedy strategies like Non-Maximum Suppression (NMS), leading to sub-optimal detection performance for novel classes. This paper systematically investigates this problem with the commonly-adopted two-stage OVOD paradigm. Specifically, in the region-proposal stage, proposals that contain novel instances showcase lower objectness scores, since they are treated as background proposals during the training phase. Meanwhile, in the object-classification stage, novel objects share lower region-text similarities (i.e., classification scores) due to the biased visual-language alignment by seen training samples. To alleviate this problem, this paper introduces two advanced measures to adjust confidence scores and conserve erroneously dismissed objects: (1) a class-agnostic localization quality estimate via overlap degree of region/object proposals, and (2) a text-guided visual similarity estimate with proxy prototypes for novel classes. Integrated with adjusting techniques specifically designed for the region-proposal and object-classification stages, this paper derives the aggregated confidence estimate for the open-vocabulary object detection paradigm (AggDet). Our AggDet is a generic and training-free post-processing scheme, which consistently bolsters open-vocabulary detectors across model scales and architecture designs. For instance, AggDet receives 3.3% and 1.5% gains on OV-COCO and OV-LVIS benchmarks respectively, without any training cost.

Generic Object Detection Based on Boosting Embedded with Bag-of-Words

Object Recognition Based on the Region of Interest and Optimal Bag of Words Model.

Generic object recognition with regional statistical models and layer joint boosting

Boosting 2-Thresholded Weak Classifiers over Scattered Rectangle Features for Object Detection.

A Generic MOT Boosting Framework by Combining Cues from SOT, Tracklet and Re-Identification

A Generic Object Detection Using a Single Query Image Without Training

Deep Learning for Generic Object Detection: A Survey

Z-Adaboost: Boosting 2-thresholded weak classifiers for object detection

Learning Cascaded Shared-Boost Classifiers for Part-Based Object Detection

An Improved Approach for Object Proposals Generation

Improving Part based Object Detection by Unsupervised, Online Boosting

Novel Framework for Multi-view Object Detection through Combining Multiple Classifiers

Training-free Boost for Open-Vocabulary Object Detection with Confidence Aggregation

Boosting Open-Vocabulary Object Detection by Handling Background Samples

Cascaded Sparse Spatial Bins for Efficient and Effective Generic Object Detection

Object Detection Using Geometrical Block Structures

High-Quality Proposals for Weakly Supervised Object Detection.

Web-Scale Generic Object Detection at Microsoft Bing

Adaptive Object Detection by Implicit Sub-Class Sharing Features

Implicit JointBoost for Multiclass Object Detection under High Intra-Class Variation

Feature-Based On-Line Object Tracking Combining Both Keypoints and Quasi-Keypoints Matching.