Abstract:Despite plenty of efforts focusing on improving the domain adaptation ability (DA) under unsupervised or few-shot semi-supervised settings, recently the solution of active learning started to attract more attention due to its suitability in transferring model in a more practical way with limited annotation resource on target data. Nevertheless, most active learning methods are not inherently designed to handle domain gap between data distribution, on the other hand, some active domain adaptation methods (ADA) usually requires complicated query functions, which is vulnerable to overfitting. In this work, we propose a concise but effective ADA method called Select-by-Distinctive-Margin (SDM), which consists of a maximum margin loss and a margin sampling algorithm for data selection. We provide theoretical analysis to show that SDM works like a Support Vector Machine, storing hard examples around decision boundaries and exploiting them to find informative and transferable data. In addition, we propose two variants of our method, one is designed to adaptively adjust the gradient from margin loss, the other boosts the selectivity of margin sampling by taking the gradient direction into account. We benchmark SDM with standard active learning setting, demonstrating our algorithm achieves competitive results with good data scalability. Code is available at https://github.com/TencentYoutuResearch/ActiveLearning-SDM

Maximizing Expected Model Change for Active Learning in Regression

Batch Mode Active Learning for Regression With Expected Model Change.

Active Learning for Classification with Maximum Model Change

Batch-Mode Active Learning of Gaussian Process Regression with Maximum Model Change

Active Learning Query Strategies for Linear Regression Based on Efficient Global Optimization

Active learning with adaptive regularization

Learning Distinctive Margin Toward Active Domain Adaptation

A Graph-Based Approach for Active Learning in Regression

Active Learning for Ranking Through Expected Loss Optimization

MaxiMin Active Learning in Overparameterized Model Classes}

Stability-Based Stopping Criterion for Active Learning

Evolutionary Selection Extreme Learning Machine Optimization for Regression.

Black-Box Batch Active Learning for Regression

regAL: Python Package for Active Learning of Regression Problems

Neural Active Learning on Heteroskedastic Distributions

Variance Maximization Via Noise Injection for Active Sampling in Learning to Rank

Big Learning Expectation Maximization

Stochastic Expectation Maximization with Variance Reduction.

Active Learning with Statistical Models

Model Change Active Learning in Graph-Based Semi-supervised Learning

Stopping Criterion for Active Learning with Model Stability.