Abstract:Oriented object detection (OOD) in remote sensing images (RSIs) remains a challenging work due to an arbitrary orientation of instances. Learning rotation-invariant features is critical in modeling a fixed descriptor for instances with its rotated variants. However, most existing methods construct the descriptor from the perspectives of data or feature augmentation, but ignore the exploration of potentially useful supervision information inside the detection algorithm. In this article, we propose an object-wise rotation-invariant semantic representation (ORSR) framework, which synergizes the exploration of latent supervision, rotation-invariant learning, and guided attention mechanism into a unified network to boost the performance of OOD in RSIs. First, supervised by our constructed pseudo-ground truth of segmentation masks, a semantic segmentation branch is built along with the detection algorithm to refine the representation of backbone features. Moreover, a consistency loss function is proposed to encourage the segmentation branch to make fixed predictions for backbone features with its rotated variants. Considering that segmentation predictions remain the same affine transformations before and after rotating, we further construct a Kullback-Leibler (KL) divergence-based similarity loss function to encourage the network to model the rotation-invariant features. Finally, we separate the "object" descriptor from the segmentation predictions to extend the implicit constraint in our proposed semantic segmentation branch. The separated "object" descriptor not only involves the spatial regularizer to emphasize the high-responsive regions in the image but also can be guided by the constructed consistency loss function. We evaluate our proposed ORSR on the challenging DOTA, DIOR-R, and HRSC2016 datasets. Extensive experiments demonstrate that the proposed ORSR achieves competitive performance compared to other single-scale and multiscale (MS) detection methods.

Towards Optimal Object Bank For Scene Classification

Object Recognition Based on the Region of Interest and Optimal Bag of Words Model.

Object2Scene: Putting Objects in Context for Open-Vocabulary 3D Detection

OVPT: Optimal Viewset Pooling Transformer for 3D Object Recognition.

Towards Optimal Bag-of-features for Object Categorization and Semantic Video Retrieval

Improving Oriented Object Detection by Scene Classification and Task-Aligned Focal Loss

Object-to-Scene: Learning to Transfer Object Knowledge to Indoor Scene Recognition

Object Recognition Using Words Model of Optimal Size in Histograms of Oriented Gradients

OCTScenes: A Versatile Real-World Dataset of Tabletop Scenes for Object-Centric Learning

Multi-Level structured image coding on high-dimensional image representation

OA-BEV: Bringing Object Awareness to Bird's-Eye-View Representation for Multi-Camera 3D Object Detection

Boosting Point Set-Based Network with Optimal Transport Optimization for Oriented Object Detection

On Improving Bounding Box Representations for Oriented Object Detection

Active learning for object-based image classification using predefined training objects

Oriented R-CNN and Beyond

Relevance Pooling Guidance and Class-Balanced Feature Enhancement for Fine-Grained Oriented Object Detection in Remote Sensing Images

Optimizing Multispectral Object Detection: A Bag of Tricks and Comprehensive Benchmarks

Residual Objectness for Imbalance Reduction

Oriented Object Detection for Remote Sensing Images via Object-Wise Rotation-Invariant Semantic Representation

Objectness Consistent Representation for Weakly Supervised Object Detection.

Learning Critical Features for Arbitrary-Oriented Object Detection in Remote-Sensing Optical Images