Abstract:Automatic speech recognition (ASR) is an important technology in many fields like video-sharing services, online education and live broadcast. Most recent ASR methods are based on deep learning technology. A dataset containing training samples of standard Mandarin and its sub-dialects can be used to train a neural network-based ASR model that can recognize standard Mandarin and its sub-dialects. Usually, due to different costs of collecting different sub-dialects, the number of training samples of standard Mandarin in the dataset is much larger than the number of training samples of sub-dialects, resulting in the recognition performance of the model for standard Mandarin being much higher than that of sub-dialects. In this paper, to enhance the recognition performance for sub-dialects, we propose to reweight the recognition loss for different sub-dialects based on their similarity to standard Mandarin. The proposed reweighting method makes the model pay more attention to sub-dialects with larger loss weights, alleviating the problem of poor recognition performance for sub-dialects. Our model was trained and validated on an open-source dataset named KeSpeech, including standard Mandarin and its eight sub-dialects. Experimental results show that the proposed model is better at recognizing most sub-dialects than the baseline and is about 0.5 lower than the baseline in Character Error Rate.

Research work on the influence of training method in mandarin connected digit speech recognition

An Improved Linear Discriminant Analysis for Mandarin Digit Speech Recognition

Research on Modeling Units of Transformer Transducer for Mandarin Speech Recognition

Improvement Comparison of Different Lattice-based Discriminative Training Methods in Chinese-monolingual and Chinese-English-bilingual Speech Recognition

Use Tone Detection to Improve Performance of Mandarin Digit Speech Recognition

Study on the Identification of the Isolated Word in Mandarin Speech Recognition with Tone Information

High Performance Digit Mandarin Speech Recognition

Research on Context-Dependent Acoustical Unit (Triphone) for Mandarin Continuous Speech Recognition

A comparable study of modeling units for end-to-end Mandarin speech recognition

Effective Acoustic Modeling for Pronunciation Quality Scoring of Strongly Accented Mandarin Speech

Use Formant Trajectory to Improve the Performance of Mandarin Digit Speech Recognition

Transformation techniques for mandarin digit string recognition

A reweighting method for speech recognition with imbalanced data of Mandarin and sub-dialects

Research on speech recognition models in the Chinese dictation machine

Discriminative Hmm Stream Model For Mandarin Digit String Speech Recognition

Investigation of Transformer Based Spelling Correction Model for CTC-based End-to-End Mandarin Speech Recognition

Mandarin-English bilingual phone modeling and combining MPE based Discriminative training for cross-language speech recognition

Investigation of Deep Neural Network Acoustic Modelling Approaches for Low Resource Accented Mandarin Speech Recognition

Advances in Cantonese Speech Recognition: A Language-Specific Pretraining Model and RNN-T Loss

The Research on Applying Tone Information in Mandarin Speech Recognition

Investigation of Modeling Units for Mandarin Speech Recognition Using Dfsmn-ctc-smbr