Abstract:Active learning (AL) attempts to maximize a model’s performance gain while annotating the fewest samples possible. Deep learning (DL) is greedy for data and requires a large amount of data supply to optimize a massive number of parameters if the model is to learn how to extract high-quality features. In recent years, due to the rapid development of internet technology, we have entered an era of information abundance characterized by massive amounts of available data. As a result, DL has attracted significant attention from researchers and has been rapidly developed. Compared with DL, however, researchers have a relatively low interest in AL. This is mainly because before the rise of DL, traditional machine learning requires relatively few labeled samples, meaning that early AL is rarely according the value it deserves. Although DL has made breakthroughs in various fields, most of this success is due to a large number of publicly available annotated datasets. However, the acquisition of a large number of high-quality annotated datasets consumes a lot of manpower, making it unfeasible in fields that require high levels of expertise (such as speech recognition, information extraction, medical images, etc.). Therefore, AL is gradually coming to receive the attention it is due. It is therefore natural to investigate whether AL can be used to reduce the cost of sample annotation while retaining the powerful learning capabilities of DL. As a result of such investigations, deep active learning (DeepAL) has emerged. Although research on this topic is quite abundant, there has not yet been a comprehensive survey of DeepAL-related works; accordingly, this article aims to fill this gap. We provide a formal classification method for the existing work, along with a comprehensive and systematic overview. In addition, we also analyze and summarize the development of DeepAL from an application perspective. Finally, we discuss the confusion and problems associated with DeepAL and provide some possible development directions.

OpenAL: An Efficient Deep Active Learning Framework for Open-Set Pathology Image Classification

Focused Active Learning for Histopathological Image Classification

Space and Level Cooperation Framework for Pathological Cancer Grading

Deep active learning for classifying cancer pathology reports

Contrastive Open-set Active Learning based Sample Selection for Image Classification

MyriadAL: Active Few Shot Learning for Histopathology

PCDAL: A Perturbation Consistency-Driven Active Learning Approach for Medical Image Segmentation and Classification

A Survey of Deep Active Learning

Avoid Wasted Annotation Costs in Open-set Active Learning with Pre-trained Vision-Language Model

Patient Aware Active Learning for Fine-Grained OCT Classification

Deep Active Learning in the Open World

A predicted-loss based active learning approach for robust cancer pathology image analysis in the workplace

Model-data-driven adversarial active learning for brain tumor segmentation

Rethinking Deep Active Learning for Medical Image Segmentation: A Diffusion and Angle-Based Framework

Revisiting Active Learning in the Era of Vision Foundation Models

Bidirectional Uncertainty-Based Active Learning for Open Set Annotation

O-MedAL: Online Active Deep Learning for Medical Image Analysis

Learning from Incorrectness: Active Learning with Negative Pre-training and Curriculum Querying for Histological Tissue Classification

Analysis-synthesis model learning with shared features: A new framework for histopathological image classification

A Survey on Active Learning: State-of-the-Art, Practical Challenges and Research Directions

A comprehensive survey on deep active learning in medical image analysis