Abstract:Sentiment analysis also referred to as opinion mining, plays a significant role in automating the identification of negative, positive, or neutral sentiments expressed in textual data. The proliferation of social networks, review sites, and blogs has rendered these platforms valuable resources for mining opinions. Sentiment analysis finds applications in various domains and languages, including English and Arabic. However, Arabic presents unique challenges due to its complex morphology characterized by inflectional and derivation patterns. To effectively analyze sentiment in Arabic text, sentiment analysis techniques must account for this intricacy. This paper proposes a model designed using the transformer model and deep learning (DL) techniques. The word embedding is represented by Transformer-based Model for Arabic Language Understanding (ArabBert), and then passed to the AraBERT model. The output of AraBERT is subsequently fed into a Long Short-Term Memory (LSTM) model, followed by feedforward neural networks and an output layer. AraBERT is used to capture rich contextual information and LSTM to enhance sequence modeling and retain long-term dependencies within the text data. We compared the proposed model with machine learning (ML) algorithms and DL algorithms, as well as different vectorization techniques: term frequency-inverse document frequency (TF-IDF), ArabBert, Continuous Bag-of-Words (CBOW), and skipGrams using four Arabic benchmark datasets. Through extensive experimentation and evaluation of Arabic sentiment analysis datasets, we showcase the effectiveness of our approach. The results underscore significant improvements in sentiment analysis accuracy, highlighting the potential of leveraging transformer models for Arabic Sentiment Analysis. The outcomes of this research contribute to advancing Arabic sentiment analysis, enabling more accurate and reliable sentiment analysis in Arabic text. The findings reveal that the proposed framework exhibits exceptional performance in sentiment classification, achieving an impressive accuracy rate of over 97%.

An enrichment multi-layer Arabic text classification model based on siblings patterns extraction

Improving Arabic sentiment analysis across context-aware attention deep model based on natural language processing

Heterogeneous Ensemble Deep Learning Model for Enhanced Arabic Sentiment Analysis

Arabic text classification using deep learning models

Deep learning CNN–LSTM framework for Arabic sentiment analysis using textual information shared in social networks

Intelligent Arabic-Based Healthcare Assistant

EnhancedBERT: A Feature-rich Ensemble Model for Arabic Word Sense Disambiguation with Statistical Analysis and Optimized Data Collection

A Machine Learning Approach For Opinion Holder Extraction In Arabic Language

BERT-Based Joint Model for Aspect Term Extraction and Aspect Polarity Detection in Arabic Text

Text recuperated using ontology with stable marriage optimization technique and text visualization using AR

A New Automatic Ontology Construction Method Based on Machine Learning Techniques: Application on financial corpus

Enhancing Arabic E-Commerce Review Sentiment Analysis Using a hybrid Deep Learning Model and FastText word embedding

EnML: Multi-label Ensemble Learning for Urdu Text Classification

A Survey on Arabic Named Entity Recognition: Past, Recent Advances, and Future Trends

A Language Model for Arabic Texts Disambiguation using Deep Learning

Managing and Retrieving Bilingual Documents Using Artificial Intelligence-Based Ontological Framework

Switching Self-Attention Text Classification Model with Innovative Reverse Positional Encoding for Right-to-Left Languages: A Focus on Arabic Dialects

Deep Neural Models and Retrofitting for Arabic Text Categorization

Personalized Smart Learning Recommendation System for Arabic Users in Smart Campus

ArabBert-LSTM: improving Arabic sentiment analysis based on transformer model and Long Short-Term Memory

Generative artificial intelligence in topic-sentiment classification for Arabic text: a comparative study with possible future directions