Abstract:A framework for dialectal Chinese speech recognition is proposed and studied, in which a relatively small dialectal Chinese (or in other words Chinese influenced by the native dialect) speech corpus and dialect-related knowledge are adopted to transform a standard Chinese (or Putonghua, abbreviated as PTH) speech recognizer into a dialectal Chinese speech recognizer. Two kinds of knowledge sources are explored: one is expert knowledge and the other is a small dialectal Chinese corpus. These knowledge sources provide information at four levels: phonetic level, lexicon level, language level, and acoustic decoder level. This paper takes Wu dialectal Chinese (WDC) as an example target language. The goal is to establish a WDC speech recognizer from an existing PTH speech recognizer based on the Initial-Final structure of the Chinese language and a study of how dialectal Chinese speakers speak Putonghua. The authors propose to use context-independent PTH-IF mappings (where IF means either a Chinese Initial or a Chinese Final), context-independent WDC-IF mappings, and syllable-dependent WDC-IF mappings (obtained from either experts or data), and combine them with the supervised maximum likelihood linear regression (MLLR) acoustic model adaptation method. To reduce the size of the multi-pronunciation lexicon introduced by the IF mappings, which might also enlarge the lexicon confusion and hence lead to the performance degradation, a Multi-Pronunciation Expansion (MPE) method based on the accumulated uni-gram probability (AUP) is proposed. In addition, some commonly used WDC words are selected and added to the lexicon. Compared with the original PTH speech recognizer, the resulting WDC speech recognizer achieves 10–18% absolute Character Error Rate (CER) reduction when recognizing WDC, with only a 0.62% CER increase when recognizing PTH. The proposed framework and methods are expected to work not only for Wu dialectal Chinese but also for other dialectal Chinese languages and even other languages.

A Speech Recognition Strategy for Specific Domain Based on Wordgraph Decoder

A Study of Large Vocabulary Speech Recognition Decoding Using Finite-State Graphs

An effective and robust approach to Mandarin spoken language understanding in specific domain

AN AUTOMATIC SPEECH RECOGNITION STRATEGY DIRECTED BY THE SEMANTIC KNOWLEDGE IN DIALOGUE SYSTEM

Application of On-Line Filler Modeling in Specific Domain Speech Recognition System

Pronunciation Generation for Foreign Language Words in Intra-Sentential Code-Switching Speech Recognition

A Speech Recognition Method Based on Domain-Specific Datasets and Confidence Decision Networks

A Deep Learning System for Domain-specific Speech Recognition

Context Directed Speech Recognition in Dialogue Systems

Dynamic Stochastic Decoding Strategy for Open-Domain Dialogue Generation

Efficient Embedded Speech Recognition for Very Large Vocabulary Mandarin Car-Navigation Systems

DECIDER: A Rule-Controllable Decoding Strategy for Language Generation by Imitating Dual-System Cognitive Theory

Efficient graph search algorithm for embedded speech recognition

Grammar-Supervised End-to-End Speech Recognition with Part-of-Speech Tagging and Dependency Parsing

Deep Graph Random Process for Relational-Thinking-Based Speech Recognition

A Dialectal Chinese Speech Recognition Framework

Personalized Speech Recognizer With Keyword-Based Personalized Lexicon And Language Model Using Word Vector Representations

Text-Only Domain Adaptation for End-to-End Speech Recognition through Down-Sampling Acoustic Representation

Domain Adversarial Training For Improving Keyword Spotting Performance Of Esl Speech

A Mandarin Speech Recognition Result Evaluation Algorithm on Mixed Words

A Fast Error-tolerant Algorithm in Decoding Module of Speech Recognition