Abstract:With the improvement of speech recognition, voice products are gradually applied to every scene of life. The existing approaches to handle various scenarios are often to build many different acoustic models using scenario-dependent data only, with each for a special scene. The obvious weakness of these approaches is that it seriously hampers the large-scale application and maintenance of voice products. To address this issue, acoustic modeling based on context-independent syllables optimized with CTC loss is presented for multiple scenarios of Mandarin speech recognition. On the one hand, context-independent modeling overcomes the shortcomings of context-dependent modeling overfitting a particular scene. Also, it sidesteps decision trees used in context-dependent modeling so that there is no need to consider the building of decision tree and whether to start training again in a real application. On the other hand, choosing longer-length syllable acoustic units can effectively preserve the co-articulation effect that context-dependent phone can model. Also, syllables in the Chinese language have its inherent advantages, as its number is fixed and it is trainable, effective generalization and better robustness. This paper also explores the differences between wideband and narrowband data caused by the front-end signal acquisition block, and proposes a unified training method based on the use of VGG in the bottom layer, and introduces layer normalization. The experimental results demonstrate that the proposed syllable-based CTC acoustic model for multiple scenarios can achieve more than 15% and 7% relatively improvement for mobile phone data and telephone data separately compare with scenarios-dependent modeling.

Syllable-Based Acoustic Modeling with CTC for Multi-Scenarios Mandarin Speech Recognition

Investigation of Modeling Units for Mandarin Speech Recognition Using Dfsmn-ctc-smbr

Acoustic Modeling With Dfsmn-Ctc And Joint Ctc-Ce Learning

Context Dependent Syllable Acoustic Model For Continuous Chinese Speech Recognition

A Chinese Acoustic Model Based On Convolutional Neural Network

Multi-Level Modeling Units for End-to-End Mandarin Speech Recognition

A comparative study on selecting acoustic modeling units in deep neural networks based large vocabulary Chinese speech recognition

A comparable study of modeling units for end-to-end Mandarin speech recognition

Enhancing CTC-based speech recognition with diverse modeling units

Research on Context-Dependent Acoustical Unit (Triphone) for Mandarin Continuous Speech Recognition

Real Context Model for Tone Recognition in Mandarin Conversational Telephone Speech

CTC Regularized Model Adaptation for Improving LSTM RNN Based Multi-Accent Mandarin Speech Recognition

Deep neural networks for syllable based acoustic modeling in Chinese speech recognition.

Multilingual Training and Cross-lingual Adaptation on CTC-based Acoustic Model

Tibetan-Mandarin Bilingual Speech Recognition Based on End-to-end Framework

Syllable-Based Acoustic Modeling with Lattice-Free MMI for Mandarin Speech Recognition

Context Dependent Initial/final Acoustic Modeling for Continuous Chinese Speech Recognition

Refining Context-Dependent Tonal Acoustic Modeling in Mandarin LVCSR

Improved context-dependent acoustic modeling for continuous Chinese speech recognition

Effective Acoustic Modeling for Pronunciation Quality Scoring of Strongly Accented Mandarin Speech

A Multi-Space Distribution (MSD) Approach to Speech Recognition of Tonal Languages