Abstract:Weakly supervised learning poses significant challenges in remote sensing (RS) object detection due to the lack of precise instance annotations. This issue becomes particularly pronounced when dealing with complex backgrounds and dense target alignments in RS images. To address above limitations, we propose a visual knowledge oriented approach to leverage visual cues as pseudo labels, thereby enhancing the supervision for object detection. The visual knowledge is mainly explored from two perspectives: Firstly, recognizing that annotations are made solely at the image level, we address this limitation by aggregating objects of the same type across a group of images that share related semantic concepts. This approach allows us to infer instance-level annotations through collective knowledge. Secondly, due to the bird’s-eye view of RS images, certain object categories display distinctive visual patterns that are identifiable via expert knowledge. Specifically, with the multi-instance self-training framework as our base model, we establish the correlation among images sharing the same class labels, the co-saliency is utilized to extract the regions of common interests, thereby obtaining initial foregrounds in each image. Moreover, by leveraging the expert knowledge of class-specific visual patterns, we refine the pseudo labels and strength the foreground feature extraction by incorporating the low-level visual cues. To further stabilize the training process and address potential noise in object proposals, we incorporate a two-stage training strategy to refine initial predictions. We validate the effectiveness of our proposed approach on two benchmark datasets, i.e. NWPU VHR-10.v2 and DIOR, and achieve mAP of 84.25% and 27.5% on these datasets, respectively, which significantly outperform trending methods.

Hierarchical object representations for visual recognition via weakly supervised learning

Hierarchical Saliency Mapping for Weakly Supervised Object Localization Based on Class Activation Mapping

Spatial Likelihood Voting with Self-Knowledge Distillation for Weakly Supervised Object Detection.

Hierarchical Fine-Grained Visual Classification Leveraging Consistent Hierarchical Knowledge

Object Categorization Based on Hierarchical Learning

Learning Hierarchical Visual Representations in Deep Neural Networks Using Hierarchical Linguistic Labels

Hierarchical Structure and Joint Training for Large Scale Semi-supervised Object Detection

Learning a Hierarchical Compositional Shape Vocabulary for Multi-class Object Representation

Hierarchical objectness network for region proposal generation and object detection.

Learning with Hierarchical Complement Objective

Supervised High-Level Feature Learning with Label Consistencies for Object Recognition.

Hierarchical Scene Parsing by Weakly Supervised Learning with Image Descriptions

Hierarchical Visual Attribute Learning in the Wild

Hierarchical Object Detection with Deep Reinforcement Learning

A Visual Knowledge Oriented Approach for Weakly Supervised Remote Sensing Object Detection

Weakly-Supervised Learning of Category-Specific 3D Object Shapes.

Hierarchical Learning for Salient Object Detection

Learning Object-Centric Representation via Reverse Hierarchy Guidance

Multi-Object Tracking by Hierarchical Visual Representations

Automatic approach to object recognition based on hierarchical model

Image-level Classification by Hierarchical Structure Learning with Visual and Semantic Similarities