Abstract:Natural Language Processing (NLP) is a vital computational method for addressing language processing, analysis, and generation. NLP tasks form the core of many daily applications, from automatic text correction to speech recognition. While significant research has focused on NLP tasks for the English language, less attention has been given to Modern Standard Arabic and Dialectal Arabic. Globalization has also contributed to the rise of Code-Switching (CS), where speakers mix languages within conversations and even within individual words (intra-word CS). This is especially common in Arab countries, where people often switch between dialects or between dialects and a foreign language they master. CS between Arabic and English is frequent in Egypt, especially on social media. Consequently, a significant amount of code-switched content can be found online. Such code-switched data needs to be investigated and analyzed for several NLP tasks to tackle the challenges of this multilingual phenomenon and Arabic language challenges. No work has been done before for several integral NLP tasks on Arabic-English CS data. In this work, we focus on the Named Entity Recognition (NER) task and other tasks that help propose a solution for the NER task on CS data, e.g., Language Identification. This work addresses this gap by proposing and applying state-of-the-art techniques for Modern Standard Arabic and Arabic-English NER. We have created the first annotated CS Arabic-English corpus for the NER task. Also, we apply two enhancement techniques to improve the NER tagger on CS data using CS contextual embeddings and data augmentation techniques. All methods showed improvements in the performance of the NER taggers on CS data. Finally, we propose several intra-word language identification approaches to determine the language type of a mixed text and identify whether it is a named entity or not.

Computational Linguistics Based Arabic Poem Classification and Dictarization Model

Heterogeneous Ensemble Deep Learning Model for Enhanced Arabic Sentiment Analysis

Deep Learning for Arabic Error Detection and Correction

Recognition of Arabic Air-Written Letters: Machine Learning, Convolutional Neural Networks, and Optical Character Recognition (OCR) Techniques

Arabic text classification using deep learning models

Effective Deep Learning Models for Automatic Diacritization of Arabic Text

Deep Learning Algorithms for Arabic Optical Character Recognition: A Survey

Switching Self-Attention Text Classification Model with Innovative Reverse Positional Encoding for Right-to-Left Languages: A Focus on Arabic Dialects

Learning meters of Arabic and English poems with Recurrent Neural Networks: a step forward for language understanding and synthesis

Improving Arabic sentiment analysis across context-aware attention deep model based on natural language processing

Dialectal Arabic Speech Recognition using CNN-LSTM Based on End-to-End Deep Learning

Computational Approaches to Arabic-English Code-Switching

Classification of Arabic Alphabets Using a Combination of a Convolutional Neural Network and the Morphological Gradient Method

Arabic Poems Generation using LSTM, Markov-LSTM and Pre-Trained GPT-2 Models

AraPoemBERT: A Pretrained Language Model for Arabic Poetry Analysis

Exploiting Dialect Identification in Automatic Dialectal Text Normalization

Ensemble learning approach for distinguishing human and computer-generated Arabic reviews

A Comparative Study of Deep Learning Approaches for Arabic Language Processing

Intelligent Arabic-Based Healthcare Assistant

A Language Model for Arabic Texts Disambiguation using Deep Learning

A deep learning based approach for extracting Arabic handwriting: applied calligraphy and old cursive