Abstract:Compared to many other dense prediction tasks, object detection plays a fundamental role in visual perception and scene understanding. Dense object detection, aiming at localizing objects directly from the feature map, has drawn great attention due to its low cost and high efficiency. Though it has been developed for a long time, the training pipeline of dense object detectors is still compromised to lots of conjunctions. In this paper, we demonstrate the existence of three conjunctions lying in the current paradigm of one-stage detectors: 1) only samples assigned as positive in classification head are used to train the regression head; 2) classification and regression share the same input feature and computational fields defined by the parallel head architecture; and 3) samples distributed in different feature pyramid layers are treated equally when computing the loss. Based on this, we propose Disentangled Dense Object Detector (DDOD), a simple, direct, and efficient framework for 2D detection with strong performance. We derive two DDOD variants (i.e., DR-CNN, and DDETR) following the basic one-stage/two-stage and recently developed transformer-based pipelines. Specifically, we develop three effective disentanglement mechanisms and integrate them into the current state-of-the-art object detectors. Extensive experiments on MS COCO benchmark show that our approach obtains significant enhancements with negligible extra overhead on various detectors. Notably, our best model reaches 55.4 mAP on the COCO test-dev set, achieving new state-of-the-art performance on this competitive benchmark. Additionally, we validate our model on several challenging tasks including small object detection and crowded object detection. The experimental results further prove the superiority of disentanglement on these conjunctions. Code is available at https://github.com/zehuichen123/DDOD .

Plain-Det: A Plain Multi-Dataset Object Detector

ScaleDet: A Scalable Multi-Dataset Object Detector

Disentangle Your Dense Object Detector

Universal Object Detection with Large Vision Model

DETR Doesn't Need Multi-Scale or Locality Design

DETR Does Not Need Multi-Scale or Locality Design

DDOD: Dive Deeper into the Disentanglement of Object Detector

DetNet: A Backbone network for Object Detection

OmDet: Large‐scale vision‐language multi‐dataset pre‐training with multimodal detection network

Language-aware Multiple Datasets Detection Pretraining for DETRs

BigDetection: A Large-scale Benchmark for Improved Object Detector Pre-training

Efficient DETR: Improving End-to-End Object Detector with Dense Prior

Mutual-Assistance Learning for Object Detection.

Cascade-DETR: Delving into High-Quality Universal Object Detection

SM3Det: A Unified Model for Multi-Modal Remote Sensing Object Detection

MCDet: Multi-Content Collaboration Detector for Multiscale Remote Sensing Object

Simple Multi-dataset Detection

DetNet: Design Backbone for Object Detection

SDSDet: A real-time object detector for small, dense, multi-scale remote sensing objects

Uni$^2$Det: Unified and Universal Framework for Prompt-Guided Multi-dataset 3D Detection

Large Batch Optimization for Object Detection: Training COCO in 12 minutes