Abstract:Active learning (AL) attempts to maximize a model’s performance gain while annotating the fewest samples possible. Deep learning (DL) is greedy for data and requires a large amount of data supply to optimize a massive number of parameters if the model is to learn how to extract high-quality features. In recent years, due to the rapid development of internet technology, we have entered an era of information abundance characterized by massive amounts of available data. As a result, DL has attracted significant attention from researchers and has been rapidly developed. Compared with DL, however, researchers have a relatively low interest in AL. This is mainly because before the rise of DL, traditional machine learning requires relatively few labeled samples, meaning that early AL is rarely according the value it deserves. Although DL has made breakthroughs in various fields, most of this success is due to a large number of publicly available annotated datasets. However, the acquisition of a large number of high-quality annotated datasets consumes a lot of manpower, making it unfeasible in fields that require high levels of expertise (such as speech recognition, information extraction, medical images, etc.). Therefore, AL is gradually coming to receive the attention it is due. It is therefore natural to investigate whether AL can be used to reduce the cost of sample annotation while retaining the powerful learning capabilities of DL. As a result of such investigations, deep active learning (DeepAL) has emerged. Although research on this topic is quite abundant, there has not yet been a comprehensive survey of DeepAL-related works; accordingly, this article aims to fill this gap. We provide a formal classification method for the existing work, along with a comprehensive and systematic overview. In addition, we also analyze and summarize the development of DeepAL from an application perspective. Finally, we discuss the confusion and problems associated with DeepAL and provide some possible development directions.

A Novel Data Augmentation Active Learning Algorithm in a Small-Sample Setting

Towards Controlled Data Augmentations for Active Learning.

Improved Neural Signal Classification in a Rapid Serial Visual Presentation Task Using Active Learning.

ATAL: Active Learning Using Adversarial Training for Data Augmentation

Active Learning with Controllable Augmentation Induced Acquisition

Data Augmentation Based on Active Virtual Sample Selection for Bearing Fault Diagnosis

Exploring Data Augmentation and Active Learning Benefits in Imbalanced Datasets

A Novel Data Augmentation Approach Using Mask Encoding for Deep Learning-Based Asynchronous SSVEP-BCI

AFALog: A General Augmentation Framework for Log-based Anomaly Detection with Active Learning

An Empirical Study on the Efficacy of Deep Active Learning Techniques

GANDALF: Graph-based transformer and Data Augmentation Active Learning Framework with interpretable features for multi-label chest Xray classification

Leveraging Variation Theory in Counterfactual Data Augmentation for Optimized Active Learning

Deep Individual Active Learning: Safeguarding Against Out-of-Distribution Challenges in Neural Networks

AutoAL: Automated Active Learning with Differentiable Query Strategy Search

Active Learning-Based Optimization of Scientific Experimental Design

Practical Obstacles to Deploying Active Learning

Data augmentation of SSVEPs using source aliasing matrix estimation for brain-computer interfaces.

Model-data-driven adversarial active learning for brain tumor segmentation

A Survey of Deep Active Learning

Deep Active Audio Feature Learning in Resource-Constrained Environments

iSSL-AL: a deep active learning framework based on self-supervised learning for image classification