Abstract:Uyghur is a minority language, and its resources for Automatic Speech Recognition (ASR) research are always insufficient. THUYG-20 is currently the only open-sourced dataset of Uyghur speeches. State-of-the-art results of its clean and noiseless speech test task haven't been updated since the first release, which shows a big gap in the development of ASR between mainstream languages and Uyghur. In this paper, we try to bridge the gap by ultimately optimizing the ASR systems, and by developing a morpheme-based decoder, MLDG-Decoder (Morpheme Lattice Dynamically Generating Decoder for Uyghur DNN-HMM systems), which has long been missing. We have open-sourced the decoder. The MLDG-Decoder employs an algorithm, named as "on-the-fly composition with FEBABOS", to allow the back-off states and transitions to play the role of a relay station in on-the-fly composition. The algorithm empowers the dynamically generated graph to constrain the morpheme sequences in the lattices as effectively as the static and fully composed graph does when a 4-Gram morpheme-based Language Model (LM) is used. We have trained deeper and wider neural network acoustic models, and experimented with three kinds of decoding schemes. The experimental results show that the decoding based on the static and fully composed graph reduces state-of-the-art Word Error Rate (WER) on the clean and noiseless speech test task in THUYG-20 to 14.24%. The MLDG-Decoder reduces the WER to 14.54% while keeping the memory consumption reasonable. Based on the open-sourced MLDG-Decoder, readers can easily reproduce the experimental results in this paper.

Improving Mongolian Phrase Break Prediction by Using Syllable and Morphological Embeddings with BiLSTM Model

A METHOD TO CONSTRUCT AN ADAPTIVE MONGOLIAN SPEECH ACOUSTIC MODEL

Automatic Phrase Breaks Prediction in Chinese Sentences

A Mongolian Language Model Based on Recurrent Neural Networks

Articulatory Movement Prediction Using Deep Bidirectional Long Short-Term Memory Based Recurrent Neural Networks and Word/phone Embeddings

An Adaptive Wordpiece Language Model For Learning Chinese Word Embeddings

Improving Prosodic Boundaries Prediction For Mandarin Speech Synthesis By Using Enhanced Embedding Feature And Model Fusion Approach

Online Handwritten Mongolian Word Recognition Using a Novel Sliding Window Method with Recurrent Neural Networks.

Improving Uyghur ASR systems with decoders using morpheme-based language models

Sliding Window Smoothing for Maximum Entropy Based Intonational Phrase Prediction in Chinese

Prosodic Word Boundaries Prediction for Mandarin Text-to-Speech

Morpheme-Based Uyghur Speech Recognition Considering Vowel Weakening

Modeling Uyghur Speech Phenomena with Morphological Rules

Word Embedding For Recurrent Neural Network Based Tts Synthesis

IMUT-MC: a Speech Corpus for Mongolian Speech Recognition

Dual Audio Encoders Based Mandarin Prosodic Boundary Prediction by Using Multi-Granularity Prosodic Representations

Low-Resource Mongolian Speech Synthesis Based on Automatic Prosody Annotation

Improving F0 prediction using bidirectional associative memories and syllable-level F0 features for HMM-based Mandarin speech synthesis

Cross-Lingual Transfer Learning for Phrase Break Prediction with Multilingual Language Model

Morpholog-Processing in Chinese-Mongolian Statistical Machine Translation

Automatic prosody prediction for Chinese speech synthesis using BLSTM-RNN and embedding features