Abstract:A framework for dialectal Chinese speech recognition is proposed and studied, in which a relatively small dialectal Chinese (or in other words Chinese influenced by the native dialect) speech corpus and dialect-related knowledge are adopted to transform a standard Chinese (or Putonghua, abbreviated as PTH) speech recognizer into a dialectal Chinese speech recognizer. Two kinds of knowledge sources are explored: one is expert knowledge and the other is a small dialectal Chinese corpus. These knowledge sources provide information at four levels: phonetic level, lexicon level, language level, and acoustic decoder level. This paper takes Wu dialectal Chinese (WDC) as an example target language. The goal is to establish a WDC speech recognizer from an existing PTH speech recognizer based on the Initial-Final structure of the Chinese language and a study of how dialectal Chinese speakers speak Putonghua. The authors propose to use context-independent PTH-IF mappings (where IF means either a Chinese Initial or a Chinese Final), context-independent WDC-IF mappings, and syllable-dependent WDC-IF mappings (obtained from either experts or data), and combine them with the supervised maximum likelihood linear regression (MLLR) acoustic model adaptation method. To reduce the size of the multi-pronunciation lexicon introduced by the IF mappings, which might also enlarge the lexicon confusion and hence lead to the performance degradation, a Multi-Pronunciation Expansion (MPE) method based on the accumulated uni-gram probability (AUP) is proposed. In addition, some commonly used WDC words are selected and added to the lexicon. Compared with the original PTH speech recognizer, the resulting WDC speech recognizer achieves 10–18% absolute Character Error Rate (CER) reduction when recognizing WDC, with only a 0.62% CER increase when recognizing PTH. The proposed framework and methods are expected to work not only for Wu dialectal Chinese but also for other dialectal Chinese languages and even other languages.

Context Directed Speech Recognition in Dialogue Systems

AN AUTOMATIC SPEECH RECOGNITION STRATEGY DIRECTED BY THE SEMANTIC KNOWLEDGE IN DIALOGUE SYSTEM

Dialogue Act Recognition Via CRF-Attentive Structured Network

Rapidly Developing Spoken Chinese Dialogue Systems with the D-Ear SDS SDK.

Robust Speech Recognition Directed by Extended Template Matching in Dialogue System

Building Context-Related Dialogue Systems Based on Chinese-Script-Dialogue Corpus

Enhancing Dialogue Speech Recognition with Robust Contextual Awareness via Noise Representation Learning

Dialog-context aware end-to-end speech recognition

A Novel Method for Dialogue Management Based on The Finite State Automaton

A Dialectal Chinese Speech Recognition Framework

Deep context modeling for multi-turn response selection in dialogue systems

A Self-Attention Joint Model for Spoken Language Understanding in Situational Dialog Applications

Local and Global Context Modeling with Relation Matching Task for Dialog Act Recognition

Mandarin Language Understanding in Dialogue Context

Continual Dialogue State Tracking via Reason-of-Select Distillation

Exploring Textual and Speech information in Dialogue Act Classification with Speaker Domain Adaptation

Easytalk: a large-vocabulary speaker-independent Chinese dictation machine

Conversational Speech Recognition by Learning Audio-textual Cross-modal Contextual Representation

Attention Based Dialogue Context Selection Model

Dialogue emotion model based on local–global context encoder and commonsense knowledge fusion attention

Dialog act guided contextual adapter for personalized speech recognition