Abstract:Sentiment analysis is a Natural Language Processing (NLP) task concerned with opinions, attitudes, emotions, and feelings. It applies NLP techniques for identifying and detecting personal information from opinionated text. Sentiment analysis deduces the author's perspective regarding a topic and classifies the attitude polarity as positive, negative, or neutral. In the meantime, deep architectures applied to NLP reported a noticeable breakthrough in performance compared to traditional approaches. The outstanding performance of deep architectures is related to their capability to disclose, differentiate and discriminate features captured from large datasets. Recurrent neural networks (RNNs) and their variants Long-Short Term Memory (LSTM), Gated Recurrent Unit (GRU), Bi-directional Long-Short Term Memory (Bi-LSTM), and Bi-directional Gated Recurrent Unit (Bi-GRU) architectures are robust at processing sequential data. They are commonly used for NLP applications as they-unlike RNNs-can combat vanishing and exploding gradients. Also, Convolution Neural Networks (CNNs) were efficiently applied for implicitly detecting features in NLP tasks. In the proposed work, different deep learning architectures composed of LSTM, GRU, Bi-LSTM, and Bi-GRU are used and compared for Arabic sentiment analysis performance improvement. The models are implemented and tested based on the character representation of opinion entries. Moreover, deep hybrid models that combine multiple layers of CNN with LSTM, GRU, Bi-LSTM, and Bi-GRU are also tested. Two datasets are used for the models implementation; the first is a hybrid combined dataset, and the second is the Book Review Arabic Dataset (BRAD). The proposed application proves that character representation can capture morphological and semantic features, and hence it can be employed for text representation in different Arabic language understanding and processing tasks.

Classical Arabic Named Entity Recognition Using Variant Deep Neural Network Architectures and BERT

Using LSTM and GRU With a New Dataset for Named Entity Recognition in the Arabic Language

A Comparative Study of Deep Learning Approaches for Arabic Language Processing

A Survey on Arabic Named Entity Recognition: Past, Recent Advances, and Future Trends

BE-BLC: BERT-ELMO-Based Deep Neural Network Architecture for English Named Entity Recognition Task

Bidirectional Encoder–Decoder Model for Arabic Named Entity Recognition

Neural Named Entity Recognition from Subword Units

mucAI at WojoodNER 2024: Arabic Named Entity Recognition with Nearest Neighbor Search

Character gated recurrent neural networks for Arabic sentiment analysis

A Benchmark Evaluation of Multilingual Large Language Models for Arabic Cross-Lingual Named-Entity Recognition

Character-level neural network for biomedical named entity recognition

Named Entity Recognition for English Language Using Deep Learning Based Bi Directional LSTM-RNN

ADOCRNet: A Deep Learning OCR for Arabic Documents Recognition

Enriching Urdu NER with BERT Embedding, Data Augmentation, and Hybrid Encoder-CNN Architecture

Weak Supervision Approach for Arabic Named Entity Recognition

A deep learning approach for Named Entity Recognition in Urdu language

Deep Neural Models and Retrofitting for Arabic Text Categorization

Impact of Using Bidirectional Encoder Representations from Transformers (BERT) Models for Arabic Dialogue Acts Identification

A deep neural network-based model for named entity recognition for Hindi language

Long short-term memory RNN for biomedical named entity recognition

Enhancing Low Resource NER Using Assisting Language And Transfer Learning