Abstract:Unlike the natural scenes, aerial objects are often in arbitrary orientations and surrounded by cluttered backgrounds, causing the heterogeneous object features contaminated with backgrounds and interleaved clustered objects. Though segmentation denoising has been proposed to enhance arbitrary-oriented object detection in previous studies, the typical semantic segmentation brings ambiguous background information and ignores the significant geometric information propagation. In this paper, we explore the non-monotonic impacts of segmentation on object detection. Based on this, we propose a novel aerial object detector named PCG-Net to enhance the semantic and geometric information, as well as, alleviate the noise interference through segmentation guidance. PCG-Net includes a pseudo-siamese multi-scale relation module (PSM), a complementary segmentation map (CSM) and a global context module with adaptive distinction(GCMA). PSM captures the critical geometric and semantic features through parallel horizontal and oriented box-wise segmentation branches with interaction. As the guidance of each branch in PSM, CSM synergizes binary segmentation map and foreground semantic segmentation map so as to refine the semantic information and restrain the ambiguous background simultaneously. Based on the segmentation features from PSM, GCMA rebuilds and complements the global contextual information with pixel-level discrimination. Through exploiting the rich semantic, geometric and contextual information, the proposed framework enhances the feature representation powerfully in aerial images and suppresses noise interference effectively. Experiment results on three challenging aerial datasets including DOTA, HRSC2016 and DIOR-R, demonstrate the effectiveness of our approach.

A Refined Hybrid Network for Object Detection in Aerial Images

Task-Specific Heterogeneous Network for Object Detection in Aerial Images

An Effective and Lightweight Hybrid Network for Object Detection in Remote Sensing Images

Affinity-Aware Relation Network for Oriented Object Detection in Aerial Images

A Slimmer Network with Polymorphic and Group Attention Modules for More Efficient Object Detection in Aerial Images

Hybrid receptive field network for small object detection on drone view

Oriented RepPoints for Aerial Object Detection

Object Detection for Aerial Images With Feature Enhancement and Soft Label Assignment

AeroDetectNet: A Lightweight, High-Precision Network for Enhanced Detection of Small Objects in Aerial Remote Sensing Imagery.

Scale Enhancement Network for Object Detection in Aerial Images

Shared-Weight-Based Multi-Dimensional Feature Alignment Network for Oriented Object Detection in Remote Sensing Imagery

Learning to Reduce Information Bottleneck for Object Detection in Aerial Images

RelationRS: Relationship Representation Network for Object Detection in Aerial Images

Drone-DETR: Efficient Small Object Detection for Remote Sensing Image Using Enhanced RT-DETR Model

Extended Feature Pyramid Network with Adaptive Scale Training Strategy and Anchors for Object Detection in Aerial Images

Improving Training Instance Quality in Aerial Image Object Detection With a Sampling-Balance-Based Multistage Network

Oriented Object Detection via Contextual Dependence Mining and Penalty-Incentive Allocation

Oriented Object Detection with Fine-Grained Enhancement and Angle Constraint

Semantic and geometric information propagation for oriented object detection in aerial images

Object Detection in Aerial Images Using Feature Fusion Deep Networks

Dense and Small Object Detection in UAV-Vision Based on a Global-Local Feature Enhanced Network