Abstract:Deep metric learning (DML) has shown to be effective for content-based image retrieval (CBIR) in remote sensing (RS). Most of DML methods for CBIR rely on a high number of annotated images to accurately learn model parameters of deep neural networks (DNNs). However, gathering such data is time-consuming and costly. To address this, we propose an annotation cost-efficient active learning (ANNEAL) method tailored to DML-driven CBIR in RS. ANNEAL aims to create a small but informative training set made up of similar and dissimilar image pairs to be utilized for accurately learning a metric space. The informativeness of image pairs is evaluated by combining uncertainty and diversity criteria. To assess the uncertainty of image pairs, we introduce two algorithms: 1) metric-guided uncertainty estimation (MGUE); and 2) binary classifier guided uncertainty estimation (BCGUE). MGUE algorithm automatically estimates a threshold value that acts as a boundary between similar and dissimilar image pairs based on the distances in the metric space. The closer the similarity between image pairs is to the estimated threshold value the higher their uncertainty. BCGUE algorithm estimates the uncertainty of the image pairs based on the confidence of the classifier in assigning correct similarity labels. The diversity criterion is assessed through a clustering-based strategy. ANNEAL combines either MGUE or BCGUE algorithm with the clustering-based strategy to select the most informative image pairs, which are then labelled by expert annotators as similar or dissimilar. This way of annotating images significantly reduces the annotation cost compared to annotating images with land-use land-cover class labels. Experimental results on two RS benchmark datasets demonstrate the effectiveness of our method. The code of this work is publicly available at \url{<a class="link-external link-https" href="https://git.tu-berlin.de/rsim/anneal_tgrs" rel="external noopener nofollow">this https URL</a>}.

Context Aware Image Annotation in Active Learning

Uncertainty-aware Complementary Label Queries for Active Learning

Labeling images by integrating sparse multiple distance learning and semantic context modeling

Annotation Cost Efficient Active Learning for Content Based Image Retrieval

Cost-Effective Active Learning for Deep Image Classification

Semi-supervised Active Learning Based on Semantic-aware Crop Consistency

A Semantic Context Model For Automatic Image Annotation

Optimizing Active Learning for Low Annotation Budgets

Annotation Cost-Efficient Active Learning for Deep Metric Learning Driven Remote Sensing Image Retrieval

Faster Human-Machine Collaboration Bounding Box Annotation Framework Based on Active Learning

Rethinking Crowdsourcing Annotation: Partial Annotation with Salient Labels for Multi-Label Image Classification

Semi-automatic Dynamic Auxiliary-Tag-aided Image Annotation

Semantic-gap-oriented active learning for multilabel image annotation.

LEAF: A Less Expert Annotation Framework with Active Learning

Context Modeling Based Automatic Image Annotation System

Improving Active Learning by Data Balance to Reduce Annotation Efforts

HAL-IA: A Hybrid Active Learning framework using Interactive Annotation for medical image segmentation

Exploiting Context Aware Category Discovery for Image Labeling.

Inconsistency-Based Data-Centric Active Open-Set Annotation

Automatic Image Annotation Based on Multi-Auxiliary Information

Cost-Effective Active Learning with Informativeness and Representativeness for Semantic Segmentation