Abstract:Deep metric learning (DML) has shown to be effective for content-based image retrieval (CBIR) in remote sensing (RS). Most of DML methods for CBIR rely on a high number of annotated images to accurately learn model parameters of deep neural networks (DNNs). However, gathering such data is time-consuming and costly. To address this, we propose an annotation cost-efficient active learning (ANNEAL) method tailored to DML-driven CBIR in RS. ANNEAL aims to create a small but informative training set made up of similar and dissimilar image pairs to be utilized for accurately learning a metric space. The informativeness of image pairs is evaluated by combining uncertainty and diversity criteria. To assess the uncertainty of image pairs, we introduce two algorithms: 1) metric-guided uncertainty estimation (MGUE); and 2) binary classifier guided uncertainty estimation (BCGUE). MGUE algorithm automatically estimates a threshold value that acts as a boundary between similar and dissimilar image pairs based on the distances in the metric space. The closer the similarity between image pairs is to the estimated threshold value the higher their uncertainty. BCGUE algorithm estimates the uncertainty of the image pairs based on the confidence of the classifier in assigning correct similarity labels. The diversity criterion is assessed through a clustering-based strategy. ANNEAL combines either MGUE or BCGUE algorithm with the clustering-based strategy to select the most informative image pairs, which are then labelled by expert annotators as similar or dissimilar. This way of annotating images significantly reduces the annotation cost compared to annotating images with land-use land-cover class labels. Experimental results on two RS benchmark datasets demonstrate the effectiveness of our method. The code of this work is publicly available at \url{<a class="link-external link-https" href="https://git.tu-berlin.de/rsim/anneal_tgrs" rel="external noopener nofollow">this https URL</a>}.

Robust Deep Metric Learning for Remote Sensing Images with Noisy Annotations

Robust Normalized Softmax Loss for Deep Metric Learning-Based Characterization of Remote Sensing Images with Label Noise

High-Rankness Regularized Semi-Supervised Deep Metric Learning for Remote Sensing Imagery

Deep Metric Learning Based on Scalable Neighborhood Components for Remote Sensing Scene Characterization

Noise-Tolerant Deep Neighborhood Embedding for Remotely Sensed Images with Label Noise

Generalized Scalable Neighborhood Component Analysis for Single and Multi-Label Remote Sensing Image Characterization

Toward Tightness of Scalable Neighborhood Component Analysis for Remote-Sensing Image Characterization

Learning Deep Networks Under Noisy Labels For Remote Sensing Image Scene Classification

Consistency-Regularized Learning for Remote Sensing Scene Classification with Noisy Labels

RS-MetaNet: Deep meta metric learning for few-shot remote sensing scene classification

Deep Learning for Multilabel Remote Sensing Image Annotation with Dual-Level Semantic Concepts

RS-MetaNet: Deep Metametric Learning for Few-Shot Remote Sensing Scene Classification

Annotation Cost-Efficient Active Learning for Deep Metric Learning Driven Remote Sensing Image Retrieval

Complementary Learning-Based Scene Classification of Remote Sensing Images with Noisy Labels

Remote Sensing Object Detection in Disturbed Environment Based on Improved RTMDet Network

NRN-RSSEG: A Deep Neural Network Model for Combating Label Noise in Semantic Segmentation of Remote Sensing Images

Deep Unsupervised Embedding for Remotely Sensed Images Based on Spatially Augmented Momentum Contrast.

Dynamic Loss Decay based Robust Oriented Object Detection on Remote Sensing Images with Noisy Labels

Robust Web Image Annotation Via Exploring Multi-Facet and Structural Knowledge

Accurate Label Refinement from Multiannotator of Remote Sensing Data

Noisy Remote Sensing Scene Classification Via Progressive Learning Based on Multiscale Information Exploration.