Abstract:Arbitrary-oriented object detection is vital for improving unmanned aerial vehicle (UAV) sensing and has promising applications. However, challenges persist in detecting objects under extreme conditions like low-illumination and strong occlusion. Cross-modal feature fusion enhances detection in complex environments but current methods do not adequately learn the features of each modality for the current environment, resulting in degraded performance. To tackle this, we propose the cross-modal aerial remote sensing image object detection (CRSIOD) network that effectively learns diverse sensor image features to capture distinct scenarios and target characteristics. First, we design an illumination perception module to guide the object detection network in performing various feature processing tasks. Second, to leverage the respective advantages of two modalities and mitigate their negative impacts, we introduce an uncertainty-aware module to quantify the uncertainties present in each modality as weights to motivate the network to learn in a direction favorable for optimal object detection. Moreover, in the object detection network, we design a two-stream backbone network based on the attention mechanism to enhance the learning of difficult samples, utilize the cross-modality attentive feature fusion (CMAFF) module to fully extract the shared and complementary features between the two modalities, and design a three-branch feature enhancement network to enhance the learning of the three modal features separately. Finally, to optimize detection results, we design light perception nonmaximum suppression (LP-NMS) and improve the horizontal detection head to a rotating one to preserve object orientation. We evaluate the proposed method CRSIOD on the Drone Vehicle dataset of public UAV aerial images. Compared with the existing commonly used methods, CRSIOD achieves state-of-the-art detection performance.

Cross-Grid Label Assignment for Arbitrary-Oriented Object Detection in Aerial Images

Sparse Label Assignment for Oriented Object Detection in Aerial Images

Cross-domain Object Detection by Local to Global Object-Aware Feature Alignment

Object Detection for Aerial Images With Feature Enhancement and Soft Label Assignment

CLAHR: Cascaded Label Assignment Head for High-Resolution Small Object Detection

Oriented RepPoints for Aerial Object Detection

Category-Aware Dynamic Label Assignment with High-Quality Oriented Proposal

EARL: An Elliptical Distribution Aided Adaptive Rotation Label Assignment for Oriented Object Detection in Remote Sensing Images

Cross-Scale Hybrid Gaussian Attention Network for Object Detection in Remote Sensing Images

Relevance Pooling Guidance and Class-Balanced Feature Enhancement for Fine-Grained Oriented Object Detection in Remote Sensing Images

DCDet: Dynamic Cross-based 3D Object Detector

Context-Aware Aerial Object Detection: Leveraging Inter-Object and Background Relationships

Feature Balance for Fine-Grained Object Classification in Aerial Images

Learning Critical Features for Arbitrary-Oriented Object Detection in Remote-Sensing Optical Images

Cross Domain Object Detection via Multi-Granularity Confidence Alignment based Mean Teacher

Cross-Modal Oriented Object Detection of UAV Aerial Images Based on Image Feature

A Refined Hybrid Network for Object Detection in Aerial Images

Cross-Attention-Driven Adaptive Graph Relational Network for Multilabel Remote Sensing Scene Classification

Aspect-Ratio-Guided Detection for Oriented Objects in Remote Sensing Images

Shape-Dependent Dynamic Label Assignment for Oriented Remote Sensing Object Detection

CLIP-Guided Source-Free Object Detection in Aerial Images