Abstract:The performance of automatic speech recognition (ASR) may be degraded when accented speech is recognized because the speech has some linguistic differences from standard speech. Conventional accented speech recognition studies have utilized the accent embedding method, in which the accent embedding features are directly fed into the ASR network. Although the method improves the performance of accented speech recognition, it has some restrictions, such as increasing the computational costs. This study proposes an efficient method of training the ASR model for accented speech in a domain adversarial way based on the Domain Adversarial Neural Network (DANN). The DANN plays a role as a domain adaptation in which the training data and test data have different distributions. Thus, our approach is expected to construct a reliable ASR model for accented speech by reducing the distribution differences between accented speech and standard speech. DANN has three sub-networks: the feature extractor, the domain classifier, and the label predictor. To adjust the DANN for accented speech recognition, we constructed these three sub-networks independently, considering the characteristics of accented speech. In particular, we used an end-to-end framework based on Connectionist Temporal Classification (CTC) to develop the label predictor, a very important module that directly affects ASR results. To verify the efficiency of the proposed approach, we conducted several experiments of accented speech recognition for four English accents including Australian, Canadian, British (England), and Indian accents. The experimental results showed that the proposed DANN-based model outperformed the baseline model for all accents, indicating that the end-to-end domain adversarial training effectively reduced the distribution differences between accented speech and standard speech.

Adaptive Attention Network with Domain Adversarial Training for Multi-Accent Speech Recognition

REDAT: Accent-Invariant Representation for End-to-End ASR by Domain Adversarial Training with Relabeling

Accented Speech Recognition Based on End-to-End Domain Adversarial Training of Neural Networks

Accent Recognition with Hybrid Phonetic Features

Domain Adversarial Training For Improving Keyword Spotting Performance Of Esl Speech

Layer-Wise Fast Adaptation for End-to-End Multi-Accent Speech Recognition

Domain-Adversarial Based Model with Phonological Knowledge for Cross-Lingual Speech Recognition

Channel-Aware Domain-Adaptive Generative Adversarial Network for Robust Speech Recognition

Improved BLSTM RNN Based Accent Speech Recognition Using Multi-task Learning and Accent Embeddings

AIPNet: Generative Adversarial Pre-training of Accent-invariant Networks for End-to-end Speech Recognition

Adversarial Learning of Raw Speech Features for Domain Invariant Speech Recognition

Wav2vec‐MoE: an Unsupervised Pre‐training and Adaptation Method for Multi‐accent ASR

Multilingual Approach to Joint Speech and Accent Recognition with DNN-HMM Framework

Deep Discriminative Feature Learning for Accent Recognition

Enhancing Synthesized Speech Detection with Dual Attention Using Features Fusion

Decoupling and Interacting Multi-Task Learning Network for Joint Speech and Accent Recognition

Synthetic Cross-accent Data Augmentation for Automatic Speech Recognition

Learning not to Discriminate: Task Agnostic Learning for Improving Monolingual and Code-switched Speech Recognition

Improving Blstm Rnn Based Mandarin Speech Recognition Using Accent Dependent Bottleneck Features

Dual-Branch Attention-In-Attention Transformer for Single-Channel Speech Enhancement

Integrated Adaptation with Multi-Factor Joint-Learning for Far-Field Speech Recognition