Abstract:Modern automatic speech recognition (ASR) systems require large amounts of data to train the acoustic model, especially with the state-of-the-art deep neural network (DNN) architecture. Unfortunately, most of the languages in the world have very limited accumulating for data resources, limiting the application of ASR technologies in these languages. The state-of-the-art approach to tackle this problem is transfer learning, by which DNNs trained with data of a rich-resource language can be reused by low-resource language systems, in the form of either feature extractor or initial model. This approach, however, still requires several hours of speech, which is still not affordable for many languages. In this study, we present a novel Map and Relabel (MaR) approach that can train ASR systems for new languages with only a few hundred labelled utterances. This approach combines transfer learning and semi-supervised learning in a boosting manner: it firstly trains a simple monophone DNN based on the limited training data, employing the popular transfer learning approach (Map phase); this model is then used to produce pseudo phone labels for a large amount of untranscribed speech (Relabel phase). These pseudo-labelled data are then used to train a full-fledged tri-phone system. Experiments on Uyghur, a major minority language in the western China, demonstrates that this MaR approach is rather successful: it can train a pretty good ASR Uyghur system by only 500 utterances. This encouraging results indicate that it is possible to quickly construct a reasonable ASR system for any language, and the only effort we need to pay is just labelling several hundred utterances.

Grammar-Based Semi-Supervised Incremental Learning in Automatic Speech Recognition and Labeling

Agmma: A Novel Incremental Adaptation Method And Its Application To Speaker Recognition

Unsupervised Active Learning: Optimizing Labeling Cost-Effectiveness for Automatic Speech Recognition

Progressive Multi-scale Self-supervised Learning for Speech Recognition

Auto-AVSR: Audio-Visual Speech Recognition with Automatic Labels

Reducing Manual Labeling in Singing Voice Detection: an Active Learning Approach

INCREMENTAL LEARNING FOR END-TO-END AUTOMATIC SPEECH RECOGNITION

Transfer Learning Using Musical Instrument Audio for Improving Automatic Singing Label Calibration

Enhancing Reinforcement Learning with Label-Sensitive Reward for Natural Language Understanding

Class-Incremental Learning based on Label Generation

Improving Sequence-to-Sequence Acoustic Modeling by Adding Text-Supervision.

A New Method for Cross-Lingual-based Semantic Role Labeling

Map and Relabel: Towards Almost-Zero Resource Speech Recognition.

Semi-supervised Learning for Code-Switching ASR with Large Language Model Filter

Unsupervised ASR via Cross-Lingual Pseudo-Labeling

Linguistic Search Optimization for Deep Learning Based LVCSR

Semi-supervised Learning For Robust Speech Evaluation

Lightly supervised acoustic model training for mandarin continuous speech recognition

Maximizing Data Efficiency for Cross-Lingual TTS Adaptation by Self-Supervised Representation Mixing and Embedding Initialization

Automatic Text Labeling Method Based on Large Language Models

Semi-Supervised Active Learning for Sound Classification in Hybrid Learning Environments