Abstract:The widespread application of convolutional neural networks (CNNs) has led to significant advancements in object detection. However, challenges remain in achieving efficient and precise extraction of critical features when applying typical CNN-based methods to remote sensing detection tasks: (1) The convolutional kernels sliding horizontally in the backbone are misaligned with the features of arbitrarily oriented objects. Additionally, the detector shares the features extracted from the backbone, but the classification task requires orientation-invariant features while the regression task requires orientation-sensitive features. The inconsistency in feature requirements makes it difficult for the detector to extract the critical features required for each task. (2) The use of deeper convolutional structures can improve the detection accuracy, but it also results in substantial convolutional computations and feature redundancy, leading to inefficient feature extraction. To address this issue, we propose a Task-Sensitive Efficient Feature Extraction Network (TFE-Net). Specifically, we propose a special mixed fast convolution module for constructing an efficient network architecture that employs cheap transform operations to replace some of the convolution operations, generating more features with fewer parameters and computation resources. Next, we introduce the task-sensitive detection module, which first aligns the convolutional features with the targets using adaptive dynamic convolution based on the orientation of the targets. The task-sensitive feature decoupling mechanism is further designed to extract orientation-sensitive features and orientation-invariant features from the aligned features and feed them into the regression and classification branches, respectively, which provide the critical features needed for different tasks, thus improving the detection performance comprehensively. In addition, in order to make the training process more stable, we propose a balanced loss function to balance the gradients generated by different samples. Extensive experiments demonstrate that our proposed TFE-Net can achieve superior performance and obtain an effective balance between detection speed and accuracy on DOTA, UCAS-AOD, and HRSC2016.

Oriented Object Detection Based on Foreground Feature Enhancement in Remote Sensing Images.

Feature Enhancement Based Oriented Object Detection in Remote Sensing Images

Fine-Grained Feature Enhancement for Object Detection in Remote Sensing Images

Task-Aligned Oriented Object Detection in Remote Sensing Images

Learning Critical Features for Arbitrary-Oriented Object Detection in Remote-Sensing Optical Images

A Refined Single-Stage Detector With Feature Enhancement and Alignment for Oriented Objects

Improving Oriented Object Detection by Scene Classification and Task-Aligned Focal Loss

Oriented Object Detection with Fine-Grained Enhancement and Angle Constraint

RAOD: refined oriented detector with augmented feature in remote sensing images object detection

Object Detection for Aerial Images With Feature Enhancement and Soft Label Assignment

Feature Enhancement Network for Object Detection in Optical Remote Sensing Images

Oriented Object Detection via Contextual Dependence Mining and Penalty-Incentive Allocation

Orientation-First Strategy With Angle Attention Module for Rotated Object Detection in Remote Sensing Images

Oriented Object Detection in Optical Remote Sensing Images using Deep Learning: A Survey

Task-Sensitive Efficient Feature Extraction Network for Oriented Object Detection in Remote Sensing Images

CoF-Net: A Progressive Coarse-to-Fine Framework for Object Detection in Remote-Sensing Imagery

An Improved DETR Based on Angle Denoising and Oriented Boxes Refinement for Remote Sensing Object Detection

Shared-Weight-Based Multi-Dimensional Feature Alignment Network for Oriented Object Detection in Remote Sensing Imagery

SREDet: Semantic-Driven Rotational Feature Enhancement for Oriented Object Detection in Remote Sensing Images

OrientedFormer: An End-to-End Transformer-Based Oriented Object Detector in Remote Sensing Images

Highly Efficient Anchor-Free Oriented Small Object Detection for Remote Sensing Images via Periodic Pseudo-Domain