Abstract:Code-Switching refers to the phenomenon of switching languages within a sentence or discourse. However, limited code-switching , different language phoneme-sets and high rebuilding costs throw a challenge to make the specialized acoustic model for code-switching speech recognition. In this paper, we make use of limited code-switching data as driving materials and explore a shortcut to quickly develop intra-sentential code-switching recognition skill on the commissioned native language acoustic model, where we propose a data-driven method to make the seed lexicon which is used to train grapheme-to-phoneme model to predict mapping pronunciations for foreign language word in code-switching sentences. The core work of the data-driven technology in this paper consists of a phonetic decoding method and different selection methods. And for imbalanced word-level driving materials problem, we have an internal assistance inspiration that learning the good pronunciation rules in the words that possess sufficient materials using the grapheme-to-phoneme model to help the scarce. Our experiments show that the Mixed Error Rate in intra-sentential Chinese-English code-switching recognition reduced from 29.15\%, acquired on the pure Chinese recognizer, to 12.13\% by adding foreign language words' pronunciation through our data-driven approach, and finally get the best result 11.14\% with the combination of different selection methods and internal assistance tactic.

Acoustic Word Embedding System for Code-Switching Query-by-example Spoken Term Detection

Enhanced Double-Carrier Word Embedding Via Phonetics and Writing

Audio Sentiment Analysis by Heterogeneous Signal Features Learned from Utterance-Based Parallel Neural Network.

Enhancing Code-Switching ASR Leveraging Non-Peaky CTC Loss and Deep Language Posterior Injection

An Effective Mixture-Of-Experts Approach For Code-Switching Speech Recognition Leveraging Encoder Disentanglement

Multilingual Query-by-Example Keyword Spotting with Metric Learning and Phoneme-to-Embedding Mapping

End-to-end Code-switched TTS with Mix of Monolingual Recordings.

Query-by-example Spoken Term Detection Based on Phonetic Posteriorgram

Exploring Retraining-Free Speech Recognition for Intra-sentential Code-Switching

Wavoice: an Mmwave-Assisted Noise-Resistant Speech Recognition System

Wavoice: an Mmwave-Assisted Noise-Resistant Speech Recognition System.

Building Bilingual and Code-Switched Voice Conversion with Limited Training Data Using Embedding Consistency Loss

Query-by-Example Keyword Spotting Using Spectral-Temporal Graph Attentive Pooling and Multi-Task Learning

Discriminative Acoustic Word Embeddings: Recurrent Neural Network-Based Approaches

Pronunciation Generation for Foreign Language Words in Intra-Sentential Code-Switching Speech Recognition

Automatic detection of contrastive word pairs using textual and acoustic features

Phonetic-and-Semantic Embedding of Spoken Words with Applications in Spoken Content Retrieval

Study of Semi-supervised Approaches to Improving English-Mandarin Code-Switching Speech Recognition

Transformer-Transducers for Code-Switched Speech Recognition

Improved Audio Embeddings by Adjacency-Based Clustering with Applications in Spoken Term Detection

Segmental Audio Word2Vec: Representing Utterances as Sequences of Vectors with Applications in Spoken Term Detection