Abstract:Object detectors typically use bounding box regressors to improve the accuracy of object localization. Currently, the two types of bounding box regression loss are $ell _{n}$ -norm-based and intersection over union ( $IoU$ )-based. However, we found that these two types of losses have their drawbacks. First, for $ell _{n}$ -norm-based loss, large-scale objects are more likely to obtain a larger penalty than the smaller ones when calculating localization errors, which will cause regression loss imbalance. Second, $ell _{n}$ -norm-based loss has symmetry so that when the predicted bounding boxes are in some unique symmetrical relationships (i.e., Symmetric Trap), the regression loss remains unchanged. Third, for $IoU$ -based loss, the overlap area and the union area do not change as the shape or relative position of two bounding boxes changes in some cases(i.e., Area Maze). To address these problems, we propose the scale balanced loss( $mathcal {L}_{SB}$ ), which is asymmetric, position-sensitive, and scale-invariant. First, in order to obtain the property of scale invariance, it is designed as a fraction to eliminate the scale information contained in the numerator and denominator. Second, by incorporating the Euclidean distance between different corner points instead of the area, $mathcal {L}_{SB}$ is sensitive to the changes of coordinates of any corner point, so as to solve the area maze problem. Finally, by incorporating the diagonals of the overlap and the smalle-t enclosing rectangle, this fraction is no longer symmetric, thus solving the symmetry trap problem. To validate the proposed algorithm, we have replaced the $ell _{n}$ -norm-based loss of YOLOv3 and SSD with $mathcal {L}_{GIoU}$ and $mathcal {L}_{SB}$ and evaluate their performance on Pascal Visual Object Classes and Microsoft Common Objects in Context benchmarks. The final results show that $mathcal {L}_{SB}$ has improved their average precisions at different $IoU$ thresholds and scales. We envision that this regression loss can also improve the performance of other visual tasks.

Bal-R$^2$CNN: High Quality Recurrent Object Detection with Balance Optimization

Improving object detection with deep convolutional networks via Bayesian optimization and structured prediction

Delving deep into the imbalance of positive proposals in two-stage object detection

Self-Balanced R-CNN for Instance Segmentation

Accurate salient object detection via dense recurrent connections and residual-based hierarchical feature integration.

R2CNN++: Multi-Dimensional Attention Based Rotation Invariant Detector with Robust Anchor Strategy.

Accurate Single Stage Detector Using Recurrent Rolling Convolution

Dynamic R-CNN: Towards High Quality Object Detection via Dynamic Training

Towards Balanced Learning for Instance Recognition

Boundary Objectness Network For Object Detection And Localization

Improved Oriented Object Detection in Remote Sensing Images Based on a Three-Point Regression Method

An Improved Faster R-CNN for Small Object Detection

High Quality Object Detection for Multiresolution Remote Sensing Imagery Using Cascaded Multi-Stage Detectors.

Improving Training Instance Quality in Aerial Image Object Detection With a Sampling-Balance-Based Multistage Network

Residual Objectness for Imbalance Reduction

Robust Bounding Box Regression for Small Object Detection

SBN: Scale Balance Network for Accurate Salient Object Detection

R-FCN plus plus : Towards Accurate Region-Based Fully Convolutional Networks for Object Detection

Multi-branch Bounding Box Regression for Object Detection

RFP-Net: Receptive field-based proposal generation network for object detection

A Scale Balanced Loss for Bounding Box Regression