Abstract:Traditional weighted finite-state transducer- (WFST) based Mongolian automatic speech recognition (ASR) systems use phonemes as pronunciation lexicon modeling units. However, Mongolian is an agglutinative, low-resource language, and building an ASR system based on the phoneme pronunciation lexicon remains a challenge for various reasons. First, the phoneme pronunciation lexicon manually constructed by Mongolian linguists is finite, which is usually used to build a grapheme-to-phoneme conversion (G2P) model to frequently expand new words. However, the data sparsity decreases the robustness of the G2P model and affects the performance of the final ASR system. Second, homophones and polysyllabic words are common in Mongolian, which has a certain impact on the construction of the Mongolian acoustic model. To address these problems, in this work, we first propose a grapheme-to-phoneme alignment model to obtain the mapping relationship between phonemes and subword units. Then, we construct an acoustic subword segmentation set to segment words directly instead of using the traditional G2P method to predict phoneme sequences to expand the pronunciation lexicon. Further, by analyzing the Mongolian encoding form, we also propose an acoustic subword modeling units construction method that removes control characters. Finally, we investigate various acoustic subword modeling units for pronunciation lexicon construction for the Mongolian ASR system. Experiments on a Mongolian dataset with 325 hours of training show that the pronunciation lexicon based on the acoustic subword modeling unit can effectively construct the WFST-based Mongolian ASR system. Further, removing the control characters when building the acoustic subword modeling unit can further improve the ASR system performance.

Selection of acoustic modeling unit for Tibetan speech recognition based on deep learning

Investigation on Acoustic Modeling with Different Phoneme Set for Continuous Lhasa Tibetan Recognition Based on Dnn Method

Mongolian acoustic modeling based on deep neural network

Lhasa Dialect Recognition of Different Phonemes Based on TDNN Method.

Effective Training End-to-End ASR systems for Low-resource Lhasa Dialect of Tibetan Language

A METHOD TO CONSTRUCT AN ADAPTIVE MONGOLIAN SPEECH ACOUSTIC MODEL

Finer-grained Modeling Units-Based Meta-Learning for Low-resource Tibetan Speech Recognition

Speech Recognition Based on Deep Neural Networks on Tibetan Corpus

Improving of Acoustic Model for the Mongolian Speech Recognition System

Tibetan-Mandarin Bilingual Speech Recognition Based on End-to-end Framework

A Comparative Study on Selecting Acoustic Modeling Units for WFST-based Mongolian Speech Recognition

Researching of Speech Recognition Oriented Mongolian Acoustic Model

A comparative study on selecting acoustic modeling units in deep neural networks based large vocabulary Chinese speech recognition

Mongolian Speech Recognition Based on Deep Neural Networks

A Chinese Acoustic Model Based On Convolutional Neural Network

Effective Fine-tuning Method for Tibetan Low-resource Dialect Speech Recognition

Improving Low-Resource Tibetan End-to-end ASR by Multilingual and Multilevel Unit Modeling

Tibetan Language Speech Recognition Model Based on Active Learning and Semi-Supervised Learning

Investigation of Modeling Units for Mandarin Speech Recognition Using Dfsmn-ctc-smbr

Tibetan Language Continuous Speech Recognition Based On Active Ws-Dbn

Multi-Level Modeling Units for End-to-End Mandarin Speech Recognition