Abstract:Sentiment analysis is a Natural Language Processing (NLP) task concerned with opinions, attitudes, emotions, and feelings. It applies NLP techniques for identifying and detecting personal information from opinionated text. Sentiment analysis deduces the author's perspective regarding a topic and classifies the attitude polarity as positive, negative, or neutral. In the meantime, deep architectures applied to NLP reported a noticeable breakthrough in performance compared to traditional approaches. The outstanding performance of deep architectures is related to their capability to disclose, differentiate and discriminate features captured from large datasets. Recurrent neural networks (RNNs) and their variants Long-Short Term Memory (LSTM), Gated Recurrent Unit (GRU), Bi-directional Long-Short Term Memory (Bi-LSTM), and Bi-directional Gated Recurrent Unit (Bi-GRU) architectures are robust at processing sequential data. They are commonly used for NLP applications as they-unlike RNNs-can combat vanishing and exploding gradients. Also, Convolution Neural Networks (CNNs) were efficiently applied for implicitly detecting features in NLP tasks. In the proposed work, different deep learning architectures composed of LSTM, GRU, Bi-LSTM, and Bi-GRU are used and compared for Arabic sentiment analysis performance improvement. The models are implemented and tested based on the character representation of opinion entries. Moreover, deep hybrid models that combine multiple layers of CNN with LSTM, GRU, Bi-LSTM, and Bi-GRU are also tested. Two datasets are used for the models implementation; the first is a hybrid combined dataset, and the second is the Book Review Arabic Dataset (BRAD). The proposed application proves that character representation can capture morphological and semantic features, and hence it can be employed for text representation in different Arabic language understanding and processing tasks.

Automated Prediction of Medieval Arabic Diacritics

Effective Deep Learning Models for Automatic Diacritization of Arabic Text

Take the Hint: Improving Arabic Diacritization with Partially-Diacritized Text

A Comparative Study of Some Automatic Arabic Text Diacritization Systems

Deep Diacritization: Efficient Hierarchical Recurrence for Improved Arabic Diacritization

Arabic Diacritics in the Wild: Exploiting Opportunities for Improved Diacritization

Heterogeneous Ensemble Deep Learning Model for Enhanced Arabic Sentiment Analysis

A classification benchmark for Arabic alphabet phonemes with diacritics in deep neural networks

BERT-Based Arabic Diacritization: A state-of-the-art approach for improving text accuracy and pronunciation

Efficient Convolutional Neural Networks for Diacritic Restoration

Arabic Text Diacritization In The Age Of Transfer Learning: Token Classification Is All You Need

Interplay of Machine Translation, Diacritics, and Diacritization

Improving Character-based Decoding Using Target-Side Morphological Information for Neural Machine Translation

Comparative analysis of Deep Learning and Machine Learning algorithms for emoji prediction from Arabic text

A prototype system for handwritten sub-word recognition: Toward Arabic-manuscript transliteration

Deep Learning for Arabic Error Detection and Correction

D-Nikud: Enhancing Hebrew Diacritization with LSTM and Pretrained Models

Hybrid approaches for automatic vowelization of Arabic texts

A Hybrid Deep Learning Model for Arabic Text Recognition

AraNet: A Deep Learning Toolkit for Arabic Social Media

Character gated recurrent neural networks for Arabic sentiment analysis