Abstract:The widespread application of convolutional neural networks (CNNs) has led to significant advancements in object detection. However, challenges remain in achieving efficient and precise extraction of critical features when applying typical CNN-based methods to remote sensing detection tasks: (1) The convolutional kernels sliding horizontally in the backbone are misaligned with the features of arbitrarily oriented objects. Additionally, the detector shares the features extracted from the backbone, but the classification task requires orientation-invariant features while the regression task requires orientation-sensitive features. The inconsistency in feature requirements makes it difficult for the detector to extract the critical features required for each task. (2) The use of deeper convolutional structures can improve the detection accuracy, but it also results in substantial convolutional computations and feature redundancy, leading to inefficient feature extraction. To address this issue, we propose a Task-Sensitive Efficient Feature Extraction Network (TFE-Net). Specifically, we propose a special mixed fast convolution module for constructing an efficient network architecture that employs cheap transform operations to replace some of the convolution operations, generating more features with fewer parameters and computation resources. Next, we introduce the task-sensitive detection module, which first aligns the convolutional features with the targets using adaptive dynamic convolution based on the orientation of the targets. The task-sensitive feature decoupling mechanism is further designed to extract orientation-sensitive features and orientation-invariant features from the aligned features and feed them into the regression and classification branches, respectively, which provide the critical features needed for different tasks, thus improving the detection performance comprehensively. In addition, in order to make the training process more stable, we propose a balanced loss function to balance the gradients generated by different samples. Extensive experiments demonstrate that our proposed TFE-Net can achieve superior performance and obtain an effective balance between detection speed and accuracy on DOTA, UCAS-AOD, and HRSC2016.

TIR-Net: Task Integration Based on Rotated Convolution Kernel for Oriented Object Detection in Aerial Images

RINet: Efficient 3D Lidar-Based Place Recognition Using Rotation Invariant Neural Network

Task-Aligned Oriented Object Detection in Remote Sensing Images

Task-Sensitive Efficient Feature Extraction Network for Oriented Object Detection in Remote Sensing Images

Learning RoI Transformer for Detecting Oriented Objects in Aerial Images

RiDOP: A Rotation-Invariant Detector with Simple Oriented Proposals in Remote Sensing Images

Learning RoI Transformer for Oriented Object Detection in Aerial Images

Adaptive Rotated Convolution for Rotated Object Detection

RotaTR: Detection Transformer for Dense and Rotated Object

ADT-Det: Adaptive Dynamic Refined Single-Stage Transformer Detector for Arbitrary-Oriented Object Detection in Satellite Optical Imagery

Effective Rotate: Learning Rotation-Robust Prototype for Aerial Object Detection

R3Det: Refined Single-Stage Detector with Feature Refinement for Rotating Object

A Refined Single-Stage Detector With Feature Enhancement and Alignment for Oriented Objects

R2CNN++: Multi-Dimensional Attention Based Rotation Invariant Detector with Robust Anchor Strategy.

RBA-CenterNet: Feature Enhancement by Rotated Border Alignment for Oriented Object Detection

TS4Net: Two-stage sample selective strategy for rotating object detection

OrientedFormer: An End-to-End Transformer-Based Oriented Object Detector in Remote Sensing Images

FPNFormer: Rethink the Method of Processing the Rotation-Invariance and Rotation-Equivariance on Arbitrary-Oriented Object Detection

Orientation-First Strategy With Angle Attention Module for Rotated Object Detection in Remote Sensing Images

An Improved DETR Based on Angle Denoising and Oriented Boxes Refinement for Remote Sensing Object Detection

Improved Oriented Object Detection in Remote Sensing Images Based on a Three-Point Regression Method