Abstract:One-stage detector basically formulates object detection as dense classification and localization. The classification is usually optimized by Focal Loss and the box location is commonly learned under Dirac delta distribution. A recent trend for one-stage detectors is to introduce an individual prediction branch to estimate the quality of localization, where the predicted quality facilitates the classification to improve detection performance. This paper delves into the representations of the above three fundamental elements: quality estimation, classification and localization. Two problems are discovered in existing practices, including (1) the inconsistent usage of the quality estimation and classification between training and inference and (2) the inflexible Dirac delta distribution for localization when there is ambiguity and uncertainty in complex scenes. To address the problems, we design new representations for these elements. Specifically, we merge the quality estimation into the class prediction vector to form a joint representation of localization quality and classification, and use a vector to represent arbitrary distribution of box locations. The improved representations eliminate the inconsistency risk and accurately depict the flexible distribution in real data, but contain continuous labels, which is beyond the scope of Focal Loss. We then propose Generalized Focal Loss (GFL) that generalizes Focal Loss from its discrete form to the continuous version for successful optimization. On COCO test-dev, GFL achieves 45.0\% AP using ResNet-101 backbone, surpassing state-of-the-art SAPD (43.5\%) and ATSS (43.6\%) with higher or comparable inference speed, under the same backbone and training settings. Notably, our best model can achieve a single-model single-scale AP of 48.2\%, at 10 FPS on a single 2080Ti GPU. Code and models are available at this https URL.

General Deformable RoI Pooling and Semi-Decoupled Head for Object Detection

Rethinking Classification and Localization for Object Detection

Decoupled Classification Refinement: Hard False Positive Suppression for Object Detection

Decouple and Align Classification and Regression in One-Stage Object Detection

Decoupled DETR: Spatially Disentangling Localization and Classification for Improved End-to-End Object Detection

DeepID-Net: Deformable Deep Convolutional Neural Networks for Object Detection

HTD: Heterogeneous Task Decoupling for Two-Stage Object Detection

Generalized Focal Loss: Learning Qualified and Distributed Bounding Boxes for Dense Object Detection

RESC: REfine the SCore with Adaptive Transformer Head for End-to-end Object Detection

YOLO-SDH: improved YOLOv5 using scaled decoupled head for object detection

Underwater small and occlusion object detection with feature fusion and global context decoupling head-based YOLO

Disentangle Your Dense Object Detector

DeepID-Net: multi-stage and deformable deep convolutional neural networks for object detection

R-FCN plus plus : Towards Accurate Region-Based Fully Convolutional Networks for Object Detection

UniHead: Unifying Multi-Perception for Detection Heads

Light-Head R-CNN: In Defense of Two-Stage Object Detector

Feature Combination Based On Receptive Fields And Cross-Fusion Feature Pyramid For Object Detection

Deep Regionlets: Blended Representation and Deep Learning for Generic Object Detection

Guided Refine-Head For Object Detection

A Decoupled YOLOv5 with Deformable Convolution and Multi-scale Attention

CoupleNet: Coupling Global Structure with Local Parts for Object Detection