Abstract:Oriented object detection (OOD) in remote sensing images (RSIs) remains a challenging work due to an arbitrary orientation of instances. Learning rotation-invariant features is critical in modeling a fixed descriptor for instances with its rotated variants. However, most existing methods construct the descriptor from the perspectives of data or feature augmentation, but ignore the exploration of potentially useful supervision information inside the detection algorithm. In this article, we propose an object-wise rotation-invariant semantic representation (ORSR) framework, which synergizes the exploration of latent supervision, rotation-invariant learning, and guided attention mechanism into a unified network to boost the performance of OOD in RSIs. First, supervised by our constructed pseudo-ground truth of segmentation masks, a semantic segmentation branch is built along with the detection algorithm to refine the representation of backbone features. Moreover, a consistency loss function is proposed to encourage the segmentation branch to make fixed predictions for backbone features with its rotated variants. Considering that segmentation predictions remain the same affine transformations before and after rotating, we further construct a Kullback-Leibler (KL) divergence-based similarity loss function to encourage the network to model the rotation-invariant features. Finally, we separate the "object" descriptor from the segmentation predictions to extend the implicit constraint in our proposed semantic segmentation branch. The separated "object" descriptor not only involves the spatial regularizer to emphasize the high-responsive regions in the image but also can be guided by the constructed consistency loss function. We evaluate our proposed ORSR on the challenging DOTA, DIOR-R, and HRSC2016 datasets. Extensive experiments demonstrate that the proposed ORSR achieves competitive performance compared to other single-scale and multiscale (MS) detection methods.

Object Detection in High-Resolution Remote Sensing Images Using Rotation Invariant Parts Based Model

Object Detection in Vhr Optical Remote Sensing Images Via Learning Rotation-Invariant Hog Feature

RADet: Refine Feature Pyramid Network and Multi-Layer Attention Network for Arbitrary-Oriented Object Detection of Remote Sensing Images

Rotation-Invariant Latent Semantic Representation Learning For Object Detection In Vhr Optical Remote Sensing Images

Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images

A Rotated Object Detection Strategy for Remote Sensing Images Using Misaligned Cross-Fusion Structures

RiDOP: A Rotation-Invariant Detector with Simple Oriented Proposals in Remote Sensing Images

Arbitrarily Oriented Dense Object Detection Based on Center Point Network in Remote Sensing Images

R2CNN++: Multi-Dimensional Attention Based Rotation Invariant Detector with Robust Anchor Strategy.

Rotating object detection in remote-sensing environment

Oriented Object Detection for Remote Sensing Images via Object-Wise Rotation-Invariant Semantic Representation

Objects detection for remote sensing images based on polar coordinates

Object detection in remote sensing imagery using a discriminatively trained mixture model

Structurally re-parameterized rotation detector for arbitrary-oriented objects in high-resolution remote sensing images

Improving remote sensing object detection by using feature extraction and rotational equivariant attention

Rotated Feature Network for Multiorientation Object Detection of Remote-Sensing Images

Multi-class Geospatial Object Detection and Geographic Image Classification Based on Collection of Part Detectors

Image feature detection as robust model fitting

Remote Sensing Object Detection in Disturbed Environment Based on Improved RTMDet Network

Rotated YOLOv4 with Attention-wise Object Detectors in Aerial Images

Remote Sensing Image Rotation Target Detection Algorithm Based on Attention Mechanism