Abstract:Dense object detection is widely used in automatic driving, video surveillance, and other fields. This paper focuses on the challenging task of dense object detection. Currently, detection methods based on greedy algorithms, such as non-maximum suppression (NMS), often produce many repetitive predictions or missed detections in dense scenarios, which is a common problem faced by NMS-based algorithms. Through the end-to-end DETR (DEtection TRansformer), as a type of detector that can incorporate the post-processing de-duplication capability of NMS, etc., into the network, we found that homogeneous queries in the query-based detector lead to a reduction in the de-duplication capability of the network and the learning efficiency of the encoder, resulting in duplicate prediction and missed detection problems. To solve this problem, we propose learnable differentiated encoding to de-homogenize the queries, and at the same time, queries can communicate with each other via differentiated encoding information, replacing the previous self-attention among the queries. In addition, we used joint loss on the output of the encoder that considered both location and confidence prediction to give a higher-quality initialization for queries. Without cumbersome decoder stacking and guaranteeing accuracy, our proposed end-to-end detection framework was more concise and reduced the number of parameters by about 8% compared to deformable DETR. Our method achieved excellent results on the challenging CrowdHuman dataset with 93.6% average precision (AP), 39.2% MR−2, and 84.3% JI. The performance overperformed previous SOTA methods, such as Iter-E2EDet (Progressive End-to-End Object Detection) and MIP (One proposal, Multiple predictions). In addition, our method is more robust in various scenarios with different densities.

A Survey of Dense Object Detection Methods Based on Deep Learning

A Survey of Deep Learning-based Object Detection

Recent advances in deep learning for object detection

A survey and performance evaluation of deep learning methods for small object detection

2D and 3D Object Detection Algorithms from Images: A Survey

New Generation Deep Learning for Video Object Detection: A Survey

A survey of modern deep learning based object detection models

Development and Challenges of Object Detection: A Survey

Dense Object Detection Based on De-Homogenized Queries

Deep Learning for Generic Object Detection: A Survey

Object Detection with Deep Learning: A Review

Recent advances in small object detection based on deep learning: A review

Investigations of Object Detection in Images/Videos Using Various Deep Learning Techniques and Embedded Platforms—A Comprehensive Review

A review of object detection: Datasets, performance evaluation, architecture, applications and current trends

A Survey of Modern Object Detection Literature using Deep Learning

A Survey of Image Object Detection Algorithm Based on Deep Learning

Research on Small Object Detection Methods Based on Deep Learning

Efficient Convolutional Neural Networks and Network Compression Methods for Object Detection: a Survey

A survey of model compression strategies for object detection

A Method for Detecting Objects in Dense Scenes