Abstract:Automatic multilingual speech recognition is always a difficult task. This paper presents recent work on the development of a Mandarin-English bilingual speech recognition system. Firstly a universal set of bilingual acoustic models based on a novel State-Time-Alignment (STA) method is proposed to balance the performance and the complexity of the bilingual speech recognition system. Then Discriminative training approaches such as discriminative Gaussian training using the minimum phone error (MPE) criterion and the discriminatively trained feature transform fMPE, which are proved to improved monolingual recognition performance, are modified to manage bilingual speech recognition system. A new method is applied to generate significantly better lattices for training the bilingual model, and complementary discriminative training methods are also explored to get the best ROVER performance in the bilingual situation. Experimental results show that the STA phone clustering method outperforms other existing phone clustering methods. Furthermore both forms of discriminative training reduce the word error rate of the multilingual system, and combining complementary discriminative training methods improves the performance significantly.

Mandarin Name Recognition Based on Variable Frame Rate HMM Training

RESEARCH AND REALISATION OF TANDEM IN MANDARIN SPEECH ERROR DETECTION SYSTEM

Recognition of Chinese Continuous Speech Based on 3-Dimension Viterbi Search

High Performance Digit Mandarin Speech Recognition

Comparative Study on VQ-Based Efficient Mandarin Speech Recognition Method

Mandarin-English bilingual phone modeling and combining MPE based Discriminative training for cross-language speech recognition

Discriminative Hmm Stream Model For Mandarin Digit String Speech Recognition

Research work on the influence of training method in mandarin connected digit speech recognition

A Mandarin Tone Recognition Algorithm Based on Random Forest and Features Fusion.

Mandarin Continuous Digit Speech Recognition System

Chinese Vowels Recognition Method Based on Non-Homogeneous Hidden Markov Model

Duration Model for post-processing in a Mandarin speech recognition system

Application of Hidden Markov Models in Speech Command Recognition

Two-level Search Strategy Based on Reverse HMM and Its Applications

Towards Robustness to Speech Rate in Mandarin All-Syllable Recognition

Research on Modeling Units of Transformer Transducer for Mandarin Speech Recognition

Mandarin accent identification based on GMM with multi-feature fusion

Robust Audio-Visual Mandarin Speech Recognition Based on Adaptive Decision Fusion and Tone Features

Phone modeling and combining discriminative training for Mandarin-English bilingual speech recognition

A System for Mandarin Short Phrase Recognition on Portable Devices

An Anti-noise Algorithm for Speaker-Dependent Mandarin Vocal Numbers Recognition