Abstract:Object detectors typically use bounding box regressors to improve the accuracy of object localization. Currently, the two types of bounding box regression loss are $ell _{n}$ -norm-based and intersection over union ( $IoU$ )-based. However, we found that these two types of losses have their drawbacks. First, for $ell _{n}$ -norm-based loss, large-scale objects are more likely to obtain a larger penalty than the smaller ones when calculating localization errors, which will cause regression loss imbalance. Second, $ell _{n}$ -norm-based loss has symmetry so that when the predicted bounding boxes are in some unique symmetrical relationships (i.e., Symmetric Trap), the regression loss remains unchanged. Third, for $IoU$ -based loss, the overlap area and the union area do not change as the shape or relative position of two bounding boxes changes in some cases(i.e., Area Maze). To address these problems, we propose the scale balanced loss( $mathcal {L}_{SB}$ ), which is asymmetric, position-sensitive, and scale-invariant. First, in order to obtain the property of scale invariance, it is designed as a fraction to eliminate the scale information contained in the numerator and denominator. Second, by incorporating the Euclidean distance between different corner points instead of the area, $mathcal {L}_{SB}$ is sensitive to the changes of coordinates of any corner point, so as to solve the area maze problem. Finally, by incorporating the diagonals of the overlap and the smalle-t enclosing rectangle, this fraction is no longer symmetric, thus solving the symmetry trap problem. To validate the proposed algorithm, we have replaced the $ell _{n}$ -norm-based loss of YOLOv3 and SSD with $mathcal {L}_{GIoU}$ and $mathcal {L}_{SB}$ and evaluate their performance on Pascal Visual Object Classes and Microsoft Common Objects in Context benchmarks. The final results show that $mathcal {L}_{SB}$ has improved their average precisions at different $IoU$ thresholds and scales. We envision that this regression loss can also improve the performance of other visual tasks.

Realizing balanced object detection through prior location scale information and repulsive loss

Rebalancing Gaussian Location Loss for High-Precision Detection on Remote Sensing Images

Residual Objectness for Imbalance Reduction

Relevance Pooling Guidance and Class-Balanced Feature Enhancement for Fine-Grained Oriented Object Detection in Remote Sensing Images

Concerning Imbalance and Bounding Box Loss to Detect Small Targets in Remote Sensing

A Scale Balanced Loss for Bounding Box Regression

Balance-Oriented Focal Loss with Linear Scheduling for Anchor Free Object Detection

Resolving Class Imbalance for LiDAR-based Object Detector by Dynamic Weight Average and Contextual Ground Truth Sampling

Not all points are balanced: Class balanced single-stage outdoor multi-class 3D object detector from point clouds

Delving deep into the imbalance of positive proposals in two-stage object detection

Sparse Label Assignment for Oriented Object Detection in Aerial Images

Let the loss impartial: a hierarchical unbiased loss for small object segmentation in high-resolution remote sensing images

Unbalanced Optimal Transport: A Unified Framework for Object Detection

Foreground-Background Imbalance Problem in Deep Object Detectors: A Review

Class Imbalance in Object Detection: An Experimental Diagnosis and Study of Mitigation Strategies

Center-Ness and Repulsion: Constraints to Improve Remote Sensing Object Detection via RepPoints

Object Detection Based on Feature Balance Pyramid in UAV Imagery.

Robust Bounding Box Regression for Small Object Detection

Hybrid Classification-Regression Adaptive Loss for Dense Object Detection

Exploiting Cross-scale Consistency for Object Detection in Aerial Images

Localization, balance and affinity: a stronger multifaceted collaborative salient object detector in remote sensing images