Abstract:Oriented object detection (OOD) in remote sensing images (RSIs) remains a challenging work due to an arbitrary orientation of instances. Learning rotation-invariant features is critical in modeling a fixed descriptor for instances with its rotated variants. However, most existing methods construct the descriptor from the perspectives of data or feature augmentation, but ignore the exploration of potentially useful supervision information inside the detection algorithm. In this article, we propose an object-wise rotation-invariant semantic representation (ORSR) framework, which synergizes the exploration of latent supervision, rotation-invariant learning, and guided attention mechanism into a unified network to boost the performance of OOD in RSIs. First, supervised by our constructed pseudo-ground truth of segmentation masks, a semantic segmentation branch is built along with the detection algorithm to refine the representation of backbone features. Moreover, a consistency loss function is proposed to encourage the segmentation branch to make fixed predictions for backbone features with its rotated variants. Considering that segmentation predictions remain the same affine transformations before and after rotating, we further construct a Kullback-Leibler (KL) divergence-based similarity loss function to encourage the network to model the rotation-invariant features. Finally, we separate the "object" descriptor from the segmentation predictions to extend the implicit constraint in our proposed semantic segmentation branch. The separated "object" descriptor not only involves the spatial regularizer to emphasize the high-responsive regions in the image but also can be guided by the constructed consistency loss function. We evaluate our proposed ORSR on the challenging DOTA, DIOR-R, and HRSC2016 datasets. Extensive experiments demonstrate that the proposed ORSR achieves competitive performance compared to other single-scale and multiscale (MS) detection methods.

Consistency-based semi-supervised learning for oriented object detection

Spatial Likelihood Voting with Self-Knowledge Distillation for Weakly Supervised Object Detection.

SOOD: Towards Semi-Supervised Oriented Object Detection

SLV: Spatial Likelihood Voting for Weakly Supervised Object Detection

SOOD++: Leveraging Unlabeled Data to Boost Oriented Object Detection

Multi-clue Consistency Learning to Bridge Gaps Between General and Oriented Object in Semi-supervised Detection

PseCo: Pseudo Labeling and Consistency Training for Semi-Supervised Object Detection

Global Focal Learning for Semi-Supervised Oriented Object Detection

CISO: Co-iteration Semi-Supervised Learning for Visual Object Detection

Adapting Object Size Variance and Class Imbalance for Semi-supervised Object Detection

Scale-Equivalent Distillation for Semi-Supervised Object Detection

Dual-Aligned Oriented Detector

Rethinking Pseudo Labels for Semi-Supervised Object Detection

Ambiguity-Resistant Semi-Supervised Learning for Dense Object Detection.

S4OD: Semi-Supervised learning for Single-Stage Object Detection

Semi-supervised Object Detection: A Survey on Recent Research and Progress

Consistent-Teacher: Towards Reducing Inconsistent Pseudo-targets in Semi-supervised Object Detection

Oriented Object Detection for Remote Sensing Images via Object-Wise Rotation-Invariant Semantic Representation

Online Open-set Semi-supervised Object Detection with Dual Competing Head

DSOD: Learning Deeply Supervised Object Detectors from Scratch

Multi-Sector Oriented Object Detector for Accurate Localization in Optical Remote Sensing Images