TinyDet: Accurate Small Object Detection in Lightweight Generic Detectors

Shaoyu Chen,Tianheng Cheng,Jiemin Fang,Qian Zhang,Yuan Li,Wenyu Liu,Xinggang Wang
2023-04-07
Abstract:Small object detection requires the detection head to scan a large number of positions on image feature maps, which is extremely hard for computation- and energy-efficient lightweight generic detectors. To accurately detect small objects with limited computation, we propose a two-stage lightweight detection framework with extremely low computation complexity, termed as TinyDet. It enables high-resolution feature maps for dense anchoring to better cover small objects, proposes a sparsely-connected convolution for computation reduction, enhances the early stage features in the backbone, and addresses the feature misalignment problem for accurate small object detection. On the COCO benchmark, our TinyDet-M achieves 30.3 AP and 13.5 AP^s with only 991 MFLOPs, which is the first detector that has an AP over 30 with less than 1 GFLOPs; besides, TinyDet-S and TinyDet-L achieve promising performance under different computation limitation.
Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The paper aims to address the performance issues of lightweight general-purpose object detectors in small object detection, especially under limited computational resources. Specifically, the paper proposes a two-stage lightweight detection framework named TinyDet, which can achieve dense anchor point localization on high-resolution feature maps while maintaining low computational complexity, thereby better covering and detecting small objects. TinyDet introduces Sparse Connection Convolution (SCConv) to reduce computation and enhances the features in the early stages of the backbone network to improve small object detection performance. Additionally, TinyDet addresses the feature misalignment problem, significantly improving the accuracy of small object detection. Experimental results show that TinyDet outperforms other lightweight detectors on the COCO dataset with lower computational costs.