Abstract:A framework for dialectal Chinese speech recognition is proposed and studied, in which a relatively small dialectal Chinese (or in other words Chinese influenced by the native dialect) speech corpus and dialect-related knowledge are adopted to transform a standard Chinese (or Putonghua, abbreviated as PTH) speech recognizer into a dialectal Chinese speech recognizer. Two kinds of knowledge sources are explored: one is expert knowledge and the other is a small dialectal Chinese corpus. These knowledge sources provide information at four levels: phonetic level, lexicon level, language level, and acoustic decoder level. This paper takes Wu dialectal Chinese (WDC) as an example target language. The goal is to establish a WDC speech recognizer from an existing PTH speech recognizer based on the Initial-Final structure of the Chinese language and a study of how dialectal Chinese speakers speak Putonghua. The authors propose to use context-independent PTH-IF mappings (where IF means either a Chinese Initial or a Chinese Final), context-independent WDC-IF mappings, and syllable-dependent WDC-IF mappings (obtained from either experts or data), and combine them with the supervised maximum likelihood linear regression (MLLR) acoustic model adaptation method. To reduce the size of the multi-pronunciation lexicon introduced by the IF mappings, which might also enlarge the lexicon confusion and hence lead to the performance degradation, a Multi-Pronunciation Expansion (MPE) method based on the accumulated uni-gram probability (AUP) is proposed. In addition, some commonly used WDC words are selected and added to the lexicon. Compared with the original PTH speech recognizer, the resulting WDC speech recognizer achieves 10–18% absolute Character Error Rate (CER) reduction when recognizing WDC, with only a 0.62% CER increase when recognizing PTH. The proposed framework and methods are expected to work not only for Wu dialectal Chinese but also for other dialectal Chinese languages and even other languages.

A Study on Yunnan Dialectal Chinese Speech Recognition

Pvd: A New Pathological Voice Dataset For Intra-Speaker Recognition Research Interest

Chinese dialect speech recognition: a comprehensive survey

Research on acoustic Model of Putian Dialect Speech Recognition Based on Deep Learning

An Mandarin Pronunciation Quality Assessment System Using Two Kinds of Acoustic Models

Effective Acoustic Modeling for Pronunciation Quality Scoring of Strongly Accented Mandarin Speech

A reweighting method for speech recognition with imbalanced data of Mandarin and sub-dialects

The Implementation of a Practical Chinese Speech Recognition System For The Parcel Post Checking Task

A Dialectal Chinese Speech Recognition Framework

KeSpeech: an Open Source Speech Dataset of Mandarin and Its Eight Subdialects.

Investigation of Deep Neural Network Acoustic Modelling Approaches for Low Resource Accented Mandarin Speech Recognition

Chinese Dialect Speech Recognition Based on End-to-end Machine Learning

End-to-end Modeling for Chinese Dialect Speech Recognition

Towards Language-Universal Mandarin-English Speech Recognition

Performance Comparison of Several Speech Recognition Methods

Acoustic Model Refining Algorithm for Pronunciation Quality Evaluation

Experiments and Analysis for Speaker Dependent Mandarin Syllable Recognition.

Reliable accent specific unit generation with dynamic Gaussian mixture selection for multi-accent speech recognition

Improving Accented Mandarin Speech Recognition by Using Recurrent Neural Network Based Language Model Adaptation

Speech recognition of south China languages based on federated learning and mathematical construction

Test-retest reliability of Mandarin monosyllable lists:a multi-center study in Chinese dialectal regions