Abstract:Active learning (AL) attempts to maximize a model’s performance gain while annotating the fewest samples possible. Deep learning (DL) is greedy for data and requires a large amount of data supply to optimize a massive number of parameters if the model is to learn how to extract high-quality features. In recent years, due to the rapid development of internet technology, we have entered an era of information abundance characterized by massive amounts of available data. As a result, DL has attracted significant attention from researchers and has been rapidly developed. Compared with DL, however, researchers have a relatively low interest in AL. This is mainly because before the rise of DL, traditional machine learning requires relatively few labeled samples, meaning that early AL is rarely according the value it deserves. Although DL has made breakthroughs in various fields, most of this success is due to a large number of publicly available annotated datasets. However, the acquisition of a large number of high-quality annotated datasets consumes a lot of manpower, making it unfeasible in fields that require high levels of expertise (such as speech recognition, information extraction, medical images, etc.). Therefore, AL is gradually coming to receive the attention it is due. It is therefore natural to investigate whether AL can be used to reduce the cost of sample annotation while retaining the powerful learning capabilities of DL. As a result of such investigations, deep active learning (DeepAL) has emerged. Although research on this topic is quite abundant, there has not yet been a comprehensive survey of DeepAL-related works; accordingly, this article aims to fill this gap. We provide a formal classification method for the existing work, along with a comprehensive and systematic overview. In addition, we also analyze and summarize the development of DeepAL from an application perspective. Finally, we discuss the confusion and problems associated with DeepAL and provide some possible development directions.

Novel Active Learning Method for Speech Recognition

A Novel and Efficient Voice Activity Detector Using Shape Features of Speech Wave.

Tibetan Language Continuous Speech Recognition Based On Active Ws-Dbn

DLD: An Optimized Chinese Speech Recognition Model Based on Deep Learning

Active Learning For Bird Sound Classification Via A Kernel-Based Extreme Learning Machine

An Active Learning Approach to Task Adaptation.

Active Learning and Semi-Supervised Learning in Tibetan Language Speech Recognition

A Chinese Acoustic Model Based On Convolutional Neural Network

Towards Better Capturing Inter-Speaker Information by Active Learning for Speaker Identification

Toward On-Line Learning of Chinese Continuous Speech Recognition System.

A Survey of Deep Active Learning

Deep Active Audio Feature Learning in Resource-Constrained Environments

Combining X-Vectors and Bayesian Batch Active Learning: Two-Stage Active Learning Pipeline for Speech Recognition

A Transcription Prompt-based Efficient Audio Large Language Model for Robust Speech Recognition

A comparative study on selecting acoustic modeling units in deep neural networks based large vocabulary Chinese speech recognition

Transfer Learning for Acoustic Modeling of Noise Robust Speech Recognition

Dynamic Speaker Selected Training for Rapid Speaker Adaptation

Nonlinear Regularization Decoding Method for Speech Recognition

Active Learning for Bird Sounds Classification

Near-Optimal Active Learning for Multilingual Grapheme-to-Phoneme Conversion

Acoustic Modeling Based On Chinese Phonetics Knowledge