Abstract:One typical phonotactic system for language recognition is parallel phone recognition followed by vector space modeling (PPRVSM). In this system, various phone recognizers are applied in parallel and fused at the score level. Each phone recognizer is trained for a known language, which is assumed to extract complementary information for effective fusion. But this method is limited by the large amount of training samples for which word or phone level transcription is required. Also, score fusion is not the optimal method as fusion at the feature or model level will retain more information than at the score level. This paper presents a new strategy to build and fuse parallel phone recognizers (PPR). This is achieved by training multiple acoustic diversified phone recognizers and fusing at the feature level. The phone recognizers are trained on the same speech data but using different acoustic features and model training techniques. For the acoustic features, Mel-frequency cepstral coefficients (MFCC) and perceptual linear prediction (PLP) are both employed. In addition, a new time-frequency cepstrum (TFC) feature is proposed to extract complementary acoustic information. For the model training, we examine the use of the maximum likelihood and feature minimum phone error methods to train complementary acoustic models. In this study, we fuse phonotactic features of the acoustic diversified phone recognizers using a simple linear fusion method to build the PPRVSM system. A novel logistic regression optimized weighting (LROW) approach is introduced for fusion factor optimization. The experimental results show that fusion at the feature level is more effective than at the score level. And the proposed system is competitive with the traditional PPRVSM. Finally, the two systems are combined for further improvement. The best performing system reported in this paper achieves an equal error rate (EER) of 1.24%, 4.98% and 14.96% on the NIST 2007 LRE 30-second, 10-second and 3-second evaluation databases, respectively, for the closed-set test condition.

Automatic Call Routing with Multiple Language Models

Location-based End-to-end Speech Recognition with Multiple Language Models

Language Model Estimation For Optimizing End-To-End Performance Of A Natural Language Call Routing System

Multi-Dialect Speech Recognition With A Single Sequence-To-Sequence Model

Mandarin-English bilingual phone modeling and combining MPE based Discriminative training for cross-language speech recognition

Language Recognition Based on Acoustic Diversified Phone Recognizers and Phonotactic Feature Fusion

A New Robust Telephone Speech Recognition Algorithm With The Multi-Model Structures

Language-agnostic Multilingual Modeling

Phone modeling and combining discriminative training for Mandarin-English bilingual speech recognition

Multi-task Recurrent Model for True Multilingual Speech Recognition

Towards Language-Universal Mandarin-English Speech Recognition

Deep joint learning for language recognition

Aligning Speech to Languages to Enhance Code-switching Speech Recognition

Enhancing Multilingual Speech Generation and Recognition Abilities in LLMs with Constructed Code-switched Data

Design and evaluation of acoustic and language models for large scale telephone services

Generative error correction for code-switching speech recognition using large language models

Enhancing Code-Switching Speech Recognition with LID-Based Collaborative Mixture of Experts Model

A Unified Framework for Multilingual Speech Recognition in Air Traffic Control Systems

Multi-stage Large Language Model Correction for Speech Recognition

Enhancing CTC-based speech recognition with diverse modeling units

Adapting Multi-Lingual ASR Models for Handling Multiple Talkers