Abstract:Unlike the natural scenes, aerial objects are often in arbitrary orientations and surrounded by cluttered backgrounds, causing the heterogeneous object features contaminated with backgrounds and interleaved clustered objects. Though segmentation denoising has been proposed to enhance arbitrary-oriented object detection in previous studies, the typical semantic segmentation brings ambiguous background information and ignores the significant geometric information propagation. In this paper, we explore the non-monotonic impacts of segmentation on object detection. Based on this, we propose a novel aerial object detector named PCG-Net to enhance the semantic and geometric information, as well as, alleviate the noise interference through segmentation guidance. PCG-Net includes a pseudo-siamese multi-scale relation module (PSM), a complementary segmentation map (CSM) and a global context module with adaptive distinction(GCMA). PSM captures the critical geometric and semantic features through parallel horizontal and oriented box-wise segmentation branches with interaction. As the guidance of each branch in PSM, CSM synergizes binary segmentation map and foreground semantic segmentation map so as to refine the semantic information and restrain the ambiguous background simultaneously. Based on the segmentation features from PSM, GCMA rebuilds and complements the global contextual information with pixel-level discrimination. Through exploiting the rich semantic, geometric and contextual information, the proposed framework enhances the feature representation powerfully in aerial images and suppresses noise interference effectively. Experiment results on three challenging aerial datasets including DOTA, HRSC2016 and DIOR-R, demonstrate the effectiveness of our approach.

Multi-scale Oriented Object Detection in Aerial Images Based on Convolutional Neural Networks with Global Attention

Multiple-Oriented and Small Object Detection with Convolutional Neural Networks for Aerial Image

Adaptive multi-level feature fusion and attention-based network for arbitrary-oriented object detection in remote sensing imagery

Towards Accurate Oriented Object Detection in Aerial Images with Adaptive Multi-level Feature Fusion.

An Anchor-Free Network with Density Map and Attention Mechanism for Multiscale Object Detection in Aerial Images

Multi-Scale Feature Integrated Attention-Based Rotation Network for Object Detection in VHR Aerial Images

Orientation robust object detection in aerial images using deep convolutional neural network

ORCNN-X: Attention-Driven Multiscale Network for Detecting Small Objects in Complex Aerial Scenes

Extended Feature Pyramid Network with Adaptive Scale Training Strategy and Anchors for Object Detection in Aerial Images

Arbitrary-Oriented Object Detection in Aerial Images with Dynamic Deformable Convolution and Self-Normalizing Channel Attention

Multiclass Object Detection in UAV Images Based on Rotation Region Network

Feature Reassembly and Self-Attention for Oriented Object Detection in Remote Sensing Images

A Refined Hybrid Network for Object Detection in Aerial Images

MRDet: A Multi-Head Network for Accurate Oriented Object Detection in Aerial Images

Shared-Weight-Based Multi-Dimensional Feature Alignment Network for Oriented Object Detection in Remote Sensing Imagery

Multi-Scale Bidirectional Feature Fusion for One-Stage Oriented Object Detection in Aerial Images.

Shallow Multiplexing and Multiscale Dilation Convolution Combined Attention Based Oriented Object Detection in Remote Sensing Images

Oriented Object Detection via Contextual Dependence Mining and Penalty-Incentive Allocation

Scale Enhancement Network for Object Detection in Aerial Images

Feature Enhancement Based Oriented Object Detection in Remote Sensing Images

Semantic and geometric information propagation for oriented object detection in aerial images