Abstract:Aerial image objects are usually orientated arbitrarily, with a large scale range, and densely distributed. Traditional horizontal bounding box (HBB) detectors tend to filter out densely distributed objects leading to missed detections, such as ship (SH) and vehicle. Therefore, oriented object detection has become a mainstream solution in recent years. The 2-D Gaussian distribution representation of the oriented bounding boxes (OBBs) solves the problem of angular discontinuity and boundary discontinuity and thus gets more attention. However, as the aspect ratio of the object gradually decreases, its predicted angular performance continues to decrease. We find that the angular gradient of an object decreases sharply as the aspect ratio decreases, resulting in a large gradient gap between a small aspect ratio object (SARO) and a large aspect ratio object (LARO). It makes the detector prefer to ignore SARO during training, which weakens the high precision performance of SARO. We call this phenomenon shape imbalance. To solve the problem, we proposed a simple gradient rebalancing strategy named shape balance. Since the shape imbalance is only related to the aspect ratio of the object, we designed a modulation function with an inverse aspect ratio to calculate the balance coefficient. The principle of the function is that the larger the aspect ratio, the smaller the balance coefficient; the smaller the aspect ratio, the larger the balance coefficient. We aim to get the balance coefficients for objects with different aspect ratios. Location loss multiplied by a balance coefficient can directly adjust the gradient gap between objects with different aspect ratios to achieve a rebalancing effect. Extensive experiments conducted on DOTA-v1.0 dataset and DIOR-R dataset verify the effectiveness of our proposed method. Our method improves the detection performance of Gaussian location loss by an average of 2.08%/1.01%(AP75/mAP) metrics on the DOTA-v1.0 dataset and 1.17%/0.82%(AP75/mAP) improvements for DIOR-R dataset.

Improving Real-world Object Detection Using Balanced Loss

Realizing balanced object detection through prior location scale information and repulsive loss

Balanced-RetinaNet: solving the imbalanced problems in object detection.

Dynamic Multi-Scale Loss Balance for Object Detection

Balance-Oriented Focal Loss with Linear Scheduling for Anchor Free Object Detection

IoU-Balanced loss functions for single-stage object detection

Overcoming Classifier Imbalance for Long-tail Object Detection with Balanced Group Softmax

An Improved Class-Balanced Training Sample Assignment Method for Object Detection

Balanced-Retinanet: Solving The Imbalanced Problems

Revisiting the Loss Weight Adjustment in Object Detection

OpenNet: Incremental Learning for Autonomous Driving Object Detection with Balanced Loss

Dynamic Multi-Scale Loss Optimization for Object Detection

Scale-Balanced Real-Time Object Detection with Varying Input-Image Resolution

Class Distribution Aware Focal Loss for Long-Tailed Object Detection

Resolving Class Imbalance for LiDAR-based Object Detector by Dynamic Weight Average and Contextual Ground Truth Sampling

Residual Objectness for Imbalance Reduction

Rebalancing Gaussian Location Loss for High-Precision Detection on Remote Sensing Images

Improving object detection with deep convolutional networks via Bayesian optimization and structured prediction

Class Imbalance in Object Detection: An Experimental Diagnosis and Study of Mitigation Strategies

Class-unbalanced Domain Adaptation for Object Detection Via Dynamic Weighting Mechanism

A Hybrid Loss Balancing Algorithm Based on Gradient Equilibrium and Sample Loss for Understanding of Road Scenes at Basic-Level