Abstract:Anchor-free aerial object detection methods have recently attracted much attention due to their simplicity and efficiency. However, the performance is still unsatisfactory due to the following two main limitations. On the one hand, the anchor-free detector employs ordinary convolution layers with axis-aligned receptive fields to extract object features, resulting in lacking internal mechanisms to handle the rotation variance. On the other hand, the detector sacrifices much semantic information to achieve faster detection, leading to the inability to deal with objects’ high interclass similarity and intraclass diversity. To address these issues, in this article, we present a unique anchor-free detector, termed rotation-insensitive point representation ( $\text{R}^{2}$ IPoints), of which a set of category-aware points are employed to encode the spatial and semantic information of the arbitrary-oriented objects. Specifically, we first devise a stacked rotation convolution module (SRM) to encourage the learning of $\text{R}^{2}$ IPoints by adaptively modeling orientation-agnostic interdependencies over stochastically rotated features. Meanwhile, we further introduce a class-specific semantic enhancement module (CSM). It performs category-aware semantic activation to recalibrate features, thus enabling the point representation to be aware of object categories. Through jointly optimizing the two proposed modules in an end-to-end manner, $\text{R}^{2}$ IPoints could simultaneously generate rotation-insensitive and category-aware point representation. Extensive experiments on the challenging DIOR and DOTA datasets demonstrate the superiority of the proposed method. We achieve 72.7% mAP on DIOR and 74.34% mAP on DOTA, surpassing the baseline method of +2.4% mAP and +2.49% mAP, respectively. The code is available at https://github.com/shnew/R2IPoints .

ARIoU: Anchor-free Rotation-decoupling IoU-based optimization for 3D object detection

Rethinking IoU-based Optimization for Single-stage 3D Object Detection

3D-SSD: Learning Hierarchical Features from RGB-D Images for Amodal 3D Object Detection

Leveraging Front and Side Cues for Occlusion Handling in Monocular 3D Object Detection

Dynamic Anchor Learning for Arbitrary-Oriented Object Detection

Optimization for Anchor-Free Object Detection via Scale-Independent GIoU Loss

Highly Efficient Anchor-Free Oriented Small Object Detection for Remote Sensing Images via Periodic Pseudo-Domain

R²IPoints: Pursuing Rotation-Insensitive Point Representation for Aerial Object Detection

DARDet: A Dense Anchor-free Rotated Object Detector in Aerial Images

ACE: Anchor-Free Corner Evolution for Real-Time Arbitrarily-Oriented Object Detection

An Anchor-Free 3D Object Detection Approach Based on Hierarchical Pillars

Anchor-Free Oriented Proposal Generator for Object Detection

RIDE: Boosting 3D Object Detection for LiDAR Point Clouds via Rotation-Invariant Analysis

3DIoUMatch: Leveraging IoU Prediction for Semi-Supervised 3D Object Detection

R2CNN++: Multi-Dimensional Attention Based Rotation Invariant Detector with Robust Anchor Strategy.

OAB-YOLOv5: One-Anchor-Based YOLOv5 for Rotated Object Detection in Remote Sensing Images

Orientation-First Strategy With Angle Attention Module for Rotated Object Detection in Remote Sensing Images

ReDet: A Rotation-equivariant Detector for Aerial Object Detection

Oriented Object Detection via Contextual Dependence Mining and Penalty-Incentive Allocation

Center-Boundary Dual Attention for Oriented Object Detection in Remote Sensing Images

3D-DFM: Anchor-Free Multimodal 3-D Object Detection With Dynamic Fusion Module for Autonomous Driving