Abstract:Lately, the problem of code-switching has gained a lot of attention and has emerged as an active area of research. In bilingual communities, the speakers commonly embed the words and phrases of a non-native language into the syntax of a native language in their day-to-day communications. The code-switching is a global phenomenon among multilingual communities, still very limited acoustic and linguistic resources are available as yet. For developing effective speech based applications, the ability of the existing language technologies to deal with the code-switched data can not be over emphasized. The code-switching is broadly classified into two modes: inter-sentential and intra-sentential code-switching. In this work, we have studied the intra-sentential problem in the context of code-switching language modeling task. The salient contributions of this paper includes: (i) the creation of Hindi-English code-switching text corpus by crawling a few blogging sites educating about the usage of the Internet (ii) the exploration of the parts-of-speech features towards more effective modeling of Hindi-English code-switched data by the monolingual language model (LM) trained on native (Hindi) language data, and (iii) the proposal of a novel textual factor referred to as the code-switch factor (CS-factor), which allows the LM to predict the code-switching instances. In the context of recognition of the code-switching data, the substantial reduction in the PPL is achieved with the use of POS factors and also the proposed CS-factor provides independent as well as additive gain in the PPL.

Improving Code-switching Language Modeling with Artificially Generated Texts using Cycle-consistent Adversarial Networks

Code-switching Sentence Generation by Generative Adversarial Networks and its Application to Data Augmentation

Data Augmentation for Code-Switch Language Modeling by Fusing Multiple Text Generation Methods.

A Deep Generative Model for Code-Switched Text

Code-Switching Text Generation and Injection in Mandarin-English ASR

Improving noisy student training for low-resource languages in End-to-End ASR using CycleGAN and inter-domain losses

Style Variation as a Vantage Point for Code-Switching

Training Code-Switching Language Model with Monolingual Data.

Syntactic and Semantic Features For Code-Switching Factored Language Models

Adapting the adapters for code-switching in multilingual ASR

Training a code-switching language model with monolingual data

Improving Zero-Shot Cross-Lingual Transfer via Progressive Code-Switching

Data Augmentation for End-to-end Code-switching Speech Recognition

New Datasets and Controllable Iterative Data Augmentation Method for Code-switching ASR Error Correction.

Data Augmentation Techniques for Machine Translation of Code-Switched Texts: A Comparative Study

CoVoSwitch: Machine Translation of Synthetic Code-Switched Text Based on Intonation Units

Language Modeling for Code-Switched Data: Challenges and Approaches

Enhancing Code-Switching ASR Leveraging Non-Peaky CTC Loss and Deep Language Posterior Injection

Better Language Models of Code through Self-Improvement

Leveraging Large Language Models for Code-Mixed Data Augmentation in Sentiment Analysis

Using heterogeneity in semi-supervised transcription hypotheses to improve code-switched speech recognition