Abstract:Weakly supervised learning poses significant challenges in remote sensing (RS) object detection due to the lack of precise instance annotations. This issue becomes particularly pronounced when dealing with complex backgrounds and dense target alignments in RS images. To address above limitations, we propose a visual knowledge oriented approach to leverage visual cues as pseudo labels, thereby enhancing the supervision for object detection. The visual knowledge is mainly explored from two perspectives: Firstly, recognizing that annotations are made solely at the image level, we address this limitation by aggregating objects of the same type across a group of images that share related semantic concepts. This approach allows us to infer instance-level annotations through collective knowledge. Secondly, due to the bird’s-eye view of RS images, certain object categories display distinctive visual patterns that are identifiable via expert knowledge. Specifically, with the multi-instance self-training framework as our base model, we establish the correlation among images sharing the same class labels, the co-saliency is utilized to extract the regions of common interests, thereby obtaining initial foregrounds in each image. Moreover, by leveraging the expert knowledge of class-specific visual patterns, we refine the pseudo labels and strength the foreground feature extraction by incorporating the low-level visual cues. To further stabilize the training process and address potential noise in object proposals, we incorporate a two-stage training strategy to refine initial predictions. We validate the effectiveness of our proposed approach on two benchmark datasets, i.e. NWPU VHR-10.v2 and DIOR, and achieve mAP of 84.25% and 27.5% on these datasets, respectively, which significantly outperform trending methods.

Exploiting Web Images for Weakly Supervised Object Detection

Spatial Likelihood Voting with Self-Knowledge Distillation for Weakly Supervised Object Detection.

CurriculumNet: Weakly Supervised Learning from Large-Scale Web Images

Exploiting Web Images for Fine-Grained Visual Recognition by Eliminating Open-Set Noise and Utilizing Hard Examples

Webly-supervised semantic segmentation via curriculum learning

Automatic Weakly Supervised Object Detection from High Spatial Resolution Remote Sensing Images Via Dynamic Curriculum Learning

Zero-Annotation Object Detection with Web Knowledge Transfer

Webly-Supervised Fine-Grained Visual Categorization Via Deep Domain Adaptation.

Exploiting Web Images for Dataset Construction: A Domain Robust Approach

Exploring Bottom-Up and Top-Down Cues With Attentive Learning for Webly Supervised Object Detection

A Visual Knowledge Oriented Approach for Weakly Supervised Remote Sensing Object Detection

Noise-Aware Fully Webly Supervised Object Detection.

A New Web-Supervised Method for Image Dataset Constructions

A weakly supervised method for 3D object detection with partially annotated samples

Multi-Label and Evolvable Dataset Preparation for Web-Based Object Detection

Leveraging Prior-Knowledge for Weakly Supervised Object Detection under a Collaborative Self-Paced Curriculum Learning Framework

Training object detectors from few weakly-lab ele d and many unlab ele d images

Augmenting Strong Supervision Using Web Data for Fine-Grained Categorization.

Webly-supervised Learning for Salient Object Detection.

An adaptive learning-based weakly supervised object detection via context awareness

Weakly Supervised Salient Object Detection Using Image Labels