Abstract:In recent decades, there has been a great deal of research into the problem of bilingual speech recognition - to develop a recognizer that can handle inter- and intra-sentential language switching between two languages. This paper presents our recent work on the development of a grammar-constrained, Mandarin-English bilingual Speech Recognition System (MESRS) for real world music retrieval. Two of the main difficult issues in handling the bilingual speech recognition systems for real world applications are tackled in this paper. One is to balance the performance and the complexity of the bilingual speech recognition system; the other is to effectively deal with the matrix language accents in embedded language**. In order to process the intra-sentential language switching and reduce the amount of data required to robustly estimate statistical models, a compact single set of bilingual acoustic models derived by phone set merging and clustering is developed instead of using two separate monolingual models for each language. In our study, a novel Two-pass phone clustering method based on Confusion Matrix (TCM) is presented and compared with the log-likelihood measure method. Experiments testify that TCM can achieve better performance. Since potential system users' native language is Mandarin which is regarded as a matrix language in our application, their pronunciations of English as the embedded language usually contain Mandarin accents. In order to deal with the matrix language accents in embedded language, different non-native adaptation approaches are investigated. Experiments show that model retraining method outperforms the other common adaptation methods such as Maximum A Posteriori (MAP). With the effective incorporation of approaches on phone clustering and non-native adaptation, the Phrase Error Rate (PER) of MESRS for English utterances was reduced by 24.47% relatively compared to the baseline monolingual English system while the PER on Mandarin utterances was comparable to that of the baseline monolingual Mandarin system. The performance for bilingual utterances achieved 22.37% relative PER reduction.

THUEE system for the Albayzin 2012 language recognition evaluation

THU-EE System Description for NIST LRE 2015

Design and implementation of a speaker recognition system

THUEE System for NIST SRE19 CTS Challenge.

THUEE system description for NIST 2020 SRE CTS challenge

THU-EE System Fusion for the NIST 2012 Speaker Recognition Evaluation.

THUEE system description for NIST 2019 SRE CTS Challenge

Thuee system description for mce 2018

The Description of Iflytek Speech Lab System for NIST2009 Language Recognition Evaluation

I4U Submission for the 2008 NIST Speaker Recognition Evaluation Submission

Ifly System for the NIST 2008 Speaker Recognition Evaluation

Homogenous Ensemble Phonotactic Language Recognition Based on SVM Supervector Reconstruction

The THUEE System for the Openkws14 Keyword Search Evaluation.

BCN2BRNO: ASR System Fusion for Albayzin 2020 Speech to Text Challenge

The 14u System In Nist 2008 Speaker Recognition Evaluation

Design of English teaching speech recognition system based on LSTM network and feature extraction

Parallel Phone Recognizer Based MLLR Speaker Recognition

High-resolution Acoustic Modeling and Compact Language Modeling of Language-Universal Speech Attributes for Spoken Language Identification.

HLT-NUS Submission for NIST 2019 Multimedia Speaker Recognition Evaluation

Development of A Mandarin-English Bilingual Speech Recognition System for Real World Music Retrieval

Language Recognition Based on Acoustic Diversified Phone Recognizers and Phonotactic Feature Fusion