Abstract:Natural Language Processing (NLP) is a vital computational method for addressing language processing, analysis, and generation. NLP tasks form the core of many daily applications, from automatic text correction to speech recognition. While significant research has focused on NLP tasks for the English language, less attention has been given to Modern Standard Arabic and Dialectal Arabic. Globalization has also contributed to the rise of Code-Switching (CS), where speakers mix languages within conversations and even within individual words (intra-word CS). This is especially common in Arab countries, where people often switch between dialects or between dialects and a foreign language they master. CS between Arabic and English is frequent in Egypt, especially on social media. Consequently, a significant amount of code-switched content can be found online. Such code-switched data needs to be investigated and analyzed for several NLP tasks to tackle the challenges of this multilingual phenomenon and Arabic language challenges. No work has been done before for several integral NLP tasks on Arabic-English CS data. In this work, we focus on the Named Entity Recognition (NER) task and other tasks that help propose a solution for the NER task on CS data, e.g., Language Identification. This work addresses this gap by proposing and applying state-of-the-art techniques for Modern Standard Arabic and Arabic-English NER. We have created the first annotated CS Arabic-English corpus for the NER task. Also, we apply two enhancement techniques to improve the NER tagger on CS data using CS contextual embeddings and data augmentation techniques. All methods showed improvements in the performance of the NER taggers on CS data. Finally, we propose several intra-word language identification approaches to determine the language type of a mixed text and identify whether it is a named entity or not.

A Survey of Code-switching: Linguistic and Social Perspectives for Language Technologies

A Survey of Code-switched Speech and Language Processing

Computational Sociolinguistics: A Survey

Representativeness as a Forgotten Lesson for Multilingual and Code-switched Data Collection and Preparation

The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challenges

Language Modeling for Code-Switched Data: Challenges and Approaches

Code-switching using aided AAC: toward an integrated theoretical framework

Enhancing Code-switching Speech Recognition with Interactive Language Biases

Computational Approaches to Arabic-English Code-Switching

CALCS 2021 Shared Task: Machine Translation for Code-Switched Data

CodeSwitch-Reddit: Exploration of Written Multilingual Discourse in Online Discussion Forums

Code-Mixed Probes Show How Pre-Trained Models Generalise On Code-Switched Text

Code-Switching in Linguistics: A Position Paper

A Corpus-based NLP Study on Code-switching in English Majors' CLIL Classrooms

The Who in Code-Switching: A Case Study for Predicting Egyptian Arabic-English Code-Switching Levels based on Character Profiles

Part of speech tagging for code switched data

Enhancing Code-Switching for Cross-lingual SLU: A Unified View of Semantic and Grammatical Coherence

ConCSE: Unified Contrastive Learning and Augmentation for Code-Switched Embeddings

Leveraging Pretrained Word Embeddings for Part-of-Speech Tagging of Code Switching Data

On Code-Switching in Job Interview for Overseas Students Returnees

Code-Switched Language Identification is Harder Than You Think