Abstract:One typical phonotactic system for language recognition is parallel phone recognition followed by vector space modeling (PPRVSM). In this system, various phone recognizers are applied in parallel and fused at the score level. Each phone recognizer is trained for a known language, which is assumed to extract complementary information for effective fusion. But this method is limited by the large amount of training samples for which word or phone level transcription is required. Also, score fusion is not the optimal method as fusion at the feature or model level will retain more information than at the score level. This paper presents a new strategy to build and fuse parallel phone recognizers (PPR). This is achieved by training multiple acoustic diversified phone recognizers and fusing at the feature level. The phone recognizers are trained on the same speech data but using different acoustic features and model training techniques. For the acoustic features, Mel-frequency cepstral coefficients (MFCC) and perceptual linear prediction (PLP) are both employed. In addition, a new time-frequency cepstrum (TFC) feature is proposed to extract complementary acoustic information. For the model training, we examine the use of the maximum likelihood and feature minimum phone error methods to train complementary acoustic models. In this study, we fuse phonotactic features of the acoustic diversified phone recognizers using a simple linear fusion method to build the PPRVSM system. A novel logistic regression optimized weighting (LROW) approach is introduced for fusion factor optimization. The experimental results show that fusion at the feature level is more effective than at the score level. And the proposed system is competitive with the traditional PPRVSM. Finally, the two systems are combined for further improvement. The best performing system reported in this paper achieves an equal error rate (EER) of 1.24%, 4.98% and 14.96% on the NIST 2007 LRE 30-second, 10-second and 3-second evaluation databases, respectively, for the closed-set test condition.

Exploring Generation of Pronunciation Lexicon for Low-Resource Language Automatic Speech Recognition Based on Generic Phone Recognizer

Language-universal phonetic encoder for low-resource speech recognition

LRSpeech: Extremely Low-Resource Speech Synthesis and Recognition

Discovering Phonetic Inventories with Crosslingual Automatic Speech Recognition

Language-Universal Phonetic Representation in Multilingual Speech Pretraining for Low-Resource Speech Recognition

Articulatory Feature Based Multilingual MLPs for Low-Resource Speech Recognition.

Deciphering Speech: a Zero-Resource Approach to Cross-Lingual Transfer in ASR

Accent Recognition with Hybrid Phonetic Features

Universal Cross-Lingual Data Generation for Low Resource ASR

Map and Relabel: Towards Almost-Zero Resource Speech Recognition.

Pronunciation Dictionary-Free Multilingual Speech Synthesis Using Learned Phonetic Representations.

Cross-Lingual and Ensemble MLPs Strategies for Low-Resource Speech Recognition

From Semi-supervised to Almost-unsupervised Speech Recognition with Very-low Resource by Jointly Learning Phonetic Structures from Audio and Text Embeddings.

Language Recognition Based on Acoustic Diversified Phone Recognizers and Phonotactic Feature Fusion

Multilingual and Crosslingual Speech Recognition Using Phonological-Vector Based Phone Embeddings

Exploring Effective Data Utilization for Low-Resource Speech Recognition

A General Procedure for Improving Language Models in Low-Resource Speech Recognition

Improvement of Acoustic Models Fused with Lip Visual Information for Low-Resource Speech

Pronunciation Generation for Foreign Language Words in Intra-Sentential Code-Switching Speech Recognition

Towards Unsupervised Speech Recognition Without Pronunciation Models

Leveraging phone-level linguistic-acoustic similarity for utterance-level pronunciation scoring