Abstract:One-stage detector basically formulates object detection as dense classification and localization. The classification is usually optimized by Focal Loss and the box location is commonly learned under Dirac delta distribution. A recent trend for one-stage detectors is to introduce an individual prediction branch to estimate the quality of localization, where the predicted quality facilitates the classification to improve detection performance. This paper delves into the representations of the above three fundamental elements: quality estimation, classification and localization. Two problems are discovered in existing practices, including (1) the inconsistent usage of the quality estimation and classification between training and inference and (2) the inflexible Dirac delta distribution for localization when there is ambiguity and uncertainty in complex scenes. To address the problems, we design new representations for these elements. Specifically, we merge the quality estimation into the class prediction vector to form a joint representation of localization quality and classification, and use a vector to represent arbitrary distribution of box locations. The improved representations eliminate the inconsistency risk and accurately depict the flexible distribution in real data, but contain continuous labels, which is beyond the scope of Focal Loss. We then propose Generalized Focal Loss (GFL) that generalizes Focal Loss from its discrete form to the continuous version for successful optimization. On COCO test-dev, GFL achieves 45.0\% AP using ResNet-101 backbone, surpassing state-of-the-art SAPD (43.5\%) and ATSS (43.6\%) with higher or comparable inference speed, under the same backbone and training settings. Notably, our best model can achieve a single-model single-scale AP of 48.2\%, at 10 FPS on a single 2080Ti GPU. Code and models are available at this https URL.

Class Distribution Aware Focal Loss for Long-Tailed Object Detection

Adaptive Class Suppression Loss for Long-Tail Object Detection

Balanced Classification: A Unified Framework for Long-Tailed Object Detection

Equalized Focal Loss for Dense Long-Tailed Object Detection

Boosting Dense Long-Tailed Object Detection from Data-Centric View

Distribution-Balanced Loss for Multi-label Classification in Long-Tailed Datasets

Generalized Focal Loss: Learning Qualified and Distributed Bounding Boxes for Dense Object Detection

Tail Classes Matter: Long-Tailed Object Detection Revisited.

Focal Loss for Dense Object Detection

Balance-Oriented Focal Loss with Linear Scheduling for Anchor Free Object Detection

Feature-Balanced Loss for Long-Tailed Visual Recognition

Long-Tailed Object Detection for Multimodal Remote Sensing Images

Rectify the Regression Bias in Long-Tailed Object Detection

Alleviating Long-Tailed Image Classification via Dynamical Classwise Splitting

Boosting Long-tailed Object Detection via Step-wise Learning on Smooth-tail Data

Long-Tailed Out-of-Distribution Detection: Prioritizing Attention to Tail

Balanced complement loss for long-tailed image classification

Long-Tailed Object Detection Pre-training: Dynamic Rebalancing Contrastive Learning with Dual Reconstruction

Adaptively Weighted Copy-Decoupling Resampling Strategy for Long-Tailed Multi-label Classification

Revisiting the Loss Weight Adjustment in Object Detection

Fractal Calibration for long-tailed object detection