Abstract:Natural Language Processing (NLP) is a vital computational method for addressing language processing, analysis, and generation. NLP tasks form the core of many daily applications, from automatic text correction to speech recognition. While significant research has focused on NLP tasks for the English language, less attention has been given to Modern Standard Arabic and Dialectal Arabic. Globalization has also contributed to the rise of Code-Switching (CS), where speakers mix languages within conversations and even within individual words (intra-word CS). This is especially common in Arab countries, where people often switch between dialects or between dialects and a foreign language they master. CS between Arabic and English is frequent in Egypt, especially on social media. Consequently, a significant amount of code-switched content can be found online. Such code-switched data needs to be investigated and analyzed for several NLP tasks to tackle the challenges of this multilingual phenomenon and Arabic language challenges. No work has been done before for several integral NLP tasks on Arabic-English CS data. In this work, we focus on the Named Entity Recognition (NER) task and other tasks that help propose a solution for the NER task on CS data, e.g., Language Identification. This work addresses this gap by proposing and applying state-of-the-art techniques for Modern Standard Arabic and Arabic-English NER. We have created the first annotated CS Arabic-English corpus for the NER task. Also, we apply two enhancement techniques to improve the NER tagger on CS data using CS contextual embeddings and data augmentation techniques. All methods showed improvements in the performance of the NER taggers on CS data. Finally, we propose several intra-word language identification approaches to determine the language type of a mixed text and identify whether it is a named entity or not.

CALCS 2021 Shared Task: Machine Translation for Code-Switched Data

Named Entity Recognition on Code-Switched Data: Overview of the CALCS 2018 Shared Task

CoSTA: Code-Switched Speech Translation using Aligned Speech-Text Interleaving

Domain Curricula for Code-Switched MT at MixMT 2022

End-to-End Speech Translation for Code Switched Speech

Can You Traducir This? Machine Translation for Code-Switched Input

Exploring Text-to-Text Transformers for English to Hinglish Machine Translation with Synthetic Code-Mixing

Towards Real-World Streaming Speech Translation for Code-Switched Speech

Language Modeling for Code-Switched Data: Challenges and Approaches

Data Augmentation Techniques for Machine Translation of Code-Switched Texts: A Comparative Study

CoVoSwitch: Machine Translation of Synthetic Code-Switched Text Based on Intonation Units

Computational Approaches to Arabic-English Code-Switching

Crowdsourcing Universal Part-Of-Speech Tags for Code-Switching

Summary on the ISCSLP 2022 Chinese-English Code-Switching ASR Challenge

Facebook AI WMT21 News Translation Task Submission

Harnessing Code Switching to Transcend the Linguistic Barrier

The Effect of Alignment Objectives on Code-Switching Translation

Machine Translation for Accessible Multi-Language Text Analysis

Switch Point biased Self-Training: Re-purposing Pretrained Models for Code-Switching

Voice@SRIB at SemEval-2020 Task 9 and 12: Stacked Ensembling method for Sentiment and Offensiveness detection in Social Media

Style Variation as a Vantage Point for Code-Switching