Abstract:Sentiment analysis is a Natural Language Processing (NLP) task concerned with opinions, attitudes, emotions, and feelings. It applies NLP techniques for identifying and detecting personal information from opinionated text. Sentiment analysis deduces the author's perspective regarding a topic and classifies the attitude polarity as positive, negative, or neutral. In the meantime, deep architectures applied to NLP reported a noticeable breakthrough in performance compared to traditional approaches. The outstanding performance of deep architectures is related to their capability to disclose, differentiate and discriminate features captured from large datasets. Recurrent neural networks (RNNs) and their variants Long-Short Term Memory (LSTM), Gated Recurrent Unit (GRU), Bi-directional Long-Short Term Memory (Bi-LSTM), and Bi-directional Gated Recurrent Unit (Bi-GRU) architectures are robust at processing sequential data. They are commonly used for NLP applications as they-unlike RNNs-can combat vanishing and exploding gradients. Also, Convolution Neural Networks (CNNs) were efficiently applied for implicitly detecting features in NLP tasks. In the proposed work, different deep learning architectures composed of LSTM, GRU, Bi-LSTM, and Bi-GRU are used and compared for Arabic sentiment analysis performance improvement. The models are implemented and tested based on the character representation of opinion entries. Moreover, deep hybrid models that combine multiple layers of CNN with LSTM, GRU, Bi-LSTM, and Bi-GRU are also tested. Two datasets are used for the models implementation; the first is a hybrid combined dataset, and the second is the Book Review Arabic Dataset (BRAD). The proposed application proves that character representation can capture morphological and semantic features, and hence it can be employed for text representation in different Arabic language understanding and processing tasks.

Bidirectional Encoder–Decoder Model for Arabic Named Entity Recognition

Using LSTM and GRU With a New Dataset for Named Entity Recognition in the Arabic Language

Classical Arabic Named Entity Recognition Using Variant Deep Neural Network Architectures and BERT

Weak Supervision Approach for Arabic Named Entity Recognition

Neural Named Entity Recognition from Subword Units

Long short-term memory RNN for biomedical named entity recognition

BE-BLC: BERT-ELMO-Based Deep Neural Network Architecture for English Named Entity Recognition Task

Heterogeneous Ensemble Deep Learning Model for Enhanced Arabic Sentiment Analysis

Switching Self-Attention Text Classification Model with Innovative Reverse Positional Encoding for Right-to-Left Languages: A Focus on Arabic Dialects

Improving Arabic sentiment analysis across context-aware attention deep model based on natural language processing

A Benchmark Evaluation of Multilingual Large Language Models for Arabic Cross-Lingual Named-Entity Recognition

Named Entity Recognition for English Language Using Deep Learning Based Bi Directional LSTM-RNN

Enriching Urdu NER with BERT Embedding, Data Augmentation, and Hybrid Encoder-CNN Architecture

Character gated recurrent neural networks for Arabic sentiment analysis

Semi-Supervised Bidirectional Long Short-Term Memory and Conditional Random Fields Model for Named-Entity Recognition Using Embeddings from Language Models Representations

Named Entity Recognition with Bidirectional LSTM-CNNs

mucAI at WojoodNER 2024: Arabic Named Entity Recognition with Nearest Neighbor Search

A Survey on Arabic Named Entity Recognition: Past, Recent Advances, and Future Trends

Named entity recognition model based on Multi‐BiLSTM and competition mechanism

Semi-supervised learning and bidirectional decoding for effective grammar correction in low-resource scenarios

A Language Model for Arabic Texts Disambiguation using Deep Learning