Abstract:With the recent advance of neural networks in audio speech recognition (ASR), Deep Neural Network Based ASR has been widely used in multiple application scenarios such as smart homes, intelligent customer service, meeting minutes, and real-time translation. However, due to the ethnic variety of China, the pronunciation for the same word is different, which is a big challenge to the speech recognition system, especially for Short Utterances. This paper analyzes three kinds of commonly used speech feature parameters: spectrogram, MFCC (Mel-scale Frequency Cepstral Coefficients), and Fbank (Filter bank) and builds the dialect classification model based on a deep neural network for a dataset of 10 dialects in China. In detail, we study the geographical features of dialects and propose a multi-task model that uses the area of the dialect as an auxiliary task and builds a hard parameter sharing based multi-task learning model. The results show that the performance of this model can achieve up to 79.96%. Furthermore, as the hard parameter sharing model cannot effectively learn the correlation between sub-tasks, we then propose a sparse parameter sharing based multitask learning model. The model uses joint training to automatically learn the correlation between sub-tasks, prune redundant networks, and share network parameters. The experiment results show that the sparse parameter sharing for the multi-task classification model achieves the best accuracy, with an average of 83.59%.

A Novel Chinese Dialect TTS Frontend with Non-Autoregressive Neural Machine Translation

A unified sequence-to-sequence front-end model for Mandarin text-to-speech synthesis

Mandarin Text-to-Speech Front-End with Lightweight Distilled Convolution Network

Improving Prosody with Linguistic and Bert Derived Features in Multi-Speaker Based Mandarin Chinese Neural TTS

End-to-end Code-switched TTS with Mix of Monolingual Recordings.

DOP-Tacotron: a Fast Chinese TTS System with Local-based Attention

Bailing-TTS: Chinese Dialectal Speech Synthesis Towards Human-like Spontaneous Representation

Scalable Multilingual Frontend for TTS

Unified Mandarin TTS Front-end Based on Distilled BERT Model

Deep Neural Network Based Chinese Dialect Classification

Unsupervised Neural Dialect Translation with Commonality and Diversity Modeling

Non-Autoregressive End-to-End TTS with Coarse-to-Fine Decoding

A unified front-end framework for English text-to-speech synthesis

Neural Speech Synthesis with Transformer Network.

Modeling Bilingual Conversational Characteristics for Neural Chat Translation

An Optimized Neural Network Based Prosody Model of Chinese Speech Synthesis System

A Novel Prosody Adaptation Method for Mandarin Concatenation-Based Text-to-speech System

Building Multi lingual TTS using Cross Lingual Voice Conversion

The NTU-AISG Text-to-speech System for Blizzard Challenge 2020

Towards Making the Most of Dialogue Characteristics for Neural Chat Translation

A Novel Method for Mandarin Speech Synthesis by Inserting Prosodic Structure Prediction into Tacotron2.