Abstract:Uyghur is a minority language, and its resources for Automatic Speech Recognition (ASR) research are always insufficient. THUYG-20 is currently the only open-sourced dataset of Uyghur speeches. State-of-the-art results of its clean and noiseless speech test task haven't been updated since the first release, which shows a big gap in the development of ASR between mainstream languages and Uyghur. In this paper, we try to bridge the gap by ultimately optimizing the ASR systems, and by developing a morpheme-based decoder, MLDG-Decoder (Morpheme Lattice Dynamically Generating Decoder for Uyghur DNN-HMM systems), which has long been missing. We have open-sourced the decoder. The MLDG-Decoder employs an algorithm, named as "on-the-fly composition with FEBABOS", to allow the back-off states and transitions to play the role of a relay station in on-the-fly composition. The algorithm empowers the dynamically generated graph to constrain the morpheme sequences in the lattices as effectively as the static and fully composed graph does when a 4-Gram morpheme-based Language Model (LM) is used. We have trained deeper and wider neural network acoustic models, and experimented with three kinds of decoding schemes. The experimental results show that the decoding based on the static and fully composed graph reduces state-of-the-art Word Error Rate (WER) on the clean and noiseless speech test task in THUYG-20 to 14.24%. The MLDG-Decoder reduces the WER to 14.54% while keeping the memory consumption reasonable. Based on the open-sourced MLDG-Decoder, readers can easily reproduce the experimental results in this paper.

Crosslingual Acoustic Modeling in Uyghur Speech Recognition

Deep Neural Network based Uyghur Large Vocabulary Continuous Speech Recognition

Improving Uyghur ASR systems with decoders using morpheme-based language models

Improving Hybrid CTC/Attention Architecture for Agglutinative Language Speech Recognition

Effective Cross-Utterance Language Modeling for Conversational Speech Recognition

Toward Better Loanword Identification in Uyghur Using Cross-lingual Word Embeddings.

Leveraging Phone Mask Training for Phonetic-Reduction-Robust E2E Uyghur Speech Recognition

Long short-term memory recurrent neural network architectures for Urdu acoustic modeling

Automatic Speech Recognition Method Based on Deep Learning Approaches for Uzbek Language

Multilingual end-to-end ASR for low-resource Turkic languages with common alphabets

PM-MMUT: Boosted Phone-Mask Data Augmentation using Multi-Modeling Unit Training for Phonetic-Reduction-Robust E2E Speech Recognition

A comparative study on selecting acoustic modeling units in deep neural networks based large vocabulary Chinese speech recognition

Uyghur Morphological Segmentation with Bidirectional GRU Neural Networks

Automatic Speech Recognition for Uyghur, Kazakh, and Kyrgyz: an Overview

Deep neural networks for syllable based acoustic modeling in Chinese speech recognition.

Multimedia Simultaneous Translation System for Minority Language Communication with Mandarin

Investigation of Deep Neural Network Acoustic Modelling Approaches for Low Resource Accented Mandarin Speech Recognition

Selection of acoustic modeling unit for Tibetan speech recognition based on deep learning

Investigating the Impact of Cross-lingual Acoustic-Phonetic Similarities on Multilingual Speech Recognition

Effective Acoustic Modeling for Pronunciation Quality Scoring of Strongly Accented Mandarin Speech

Hidden Markov Acoustic Modeling with Bootstrap and Restructuring for Low-Resourced Languages