Abstract:Sentiment analysis also referred to as opinion mining, plays a significant role in automating the identification of negative, positive, or neutral sentiments expressed in textual data. The proliferation of social networks, review sites, and blogs has rendered these platforms valuable resources for mining opinions. Sentiment analysis finds applications in various domains and languages, including English and Arabic. However, Arabic presents unique challenges due to its complex morphology characterized by inflectional and derivation patterns. To effectively analyze sentiment in Arabic text, sentiment analysis techniques must account for this intricacy. This paper proposes a model designed using the transformer model and deep learning (DL) techniques. The word embedding is represented by Transformer-based Model for Arabic Language Understanding (ArabBert), and then passed to the AraBERT model. The output of AraBERT is subsequently fed into a Long Short-Term Memory (LSTM) model, followed by feedforward neural networks and an output layer. AraBERT is used to capture rich contextual information and LSTM to enhance sequence modeling and retain long-term dependencies within the text data. We compared the proposed model with machine learning (ML) algorithms and DL algorithms, as well as different vectorization techniques: term frequency-inverse document frequency (TF-IDF), ArabBert, Continuous Bag-of-Words (CBOW), and skipGrams using four Arabic benchmark datasets. Through extensive experimentation and evaluation of Arabic sentiment analysis datasets, we showcase the effectiveness of our approach. The results underscore significant improvements in sentiment analysis accuracy, highlighting the potential of leveraging transformer models for Arabic Sentiment Analysis. The outcomes of this research contribute to advancing Arabic sentiment analysis, enabling more accurate and reliable sentiment analysis in Arabic text. The findings reveal that the proposed framework exhibits exceptional performance in sentiment classification, achieving an impressive accuracy rate of over 97%.

AraLegal-BERT: A pretrained language model for Arabic Legal text

LEGAL-BERT: The Muppets straight out of Law School

ArabLegalEval: A Multitask Benchmark for Assessing Arabic Legal Knowledge in Large Language Models

Prediction of Arabic Legal Rulings using Large Language Models

Comparing the Performance of NLP Toolkits and Evaluation measures in Legal Tech

Impact of Using Bidirectional Encoder Representations from Transformers (BERT) Models for Arabic Dialogue Acts Identification

Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language Understanding

AraPoemBERT: A Pretrained Language Model for Arabic Poetry Analysis

ABioNER: A BERT-Based Model for Arabic Biomedical Named-Entity Recognition

AraXLNet: pre-trained language model for sentiment analysis of Arabic

Pre-trained Language Models for the Legal Domain: A Case Study on Indian Law

LegalTurk Optimized BERT for Multi-Label Text Classification and NER

ArabBert-LSTM: improving Arabic sentiment analysis based on transformer model and Long Short-Term Memory

ALKAFI-LLAMA3: Fine-Tuning LLMs for Precise Legal Understanding in Palestine

Empathetic BERT2BERT Conversational Model: Learning Arabic Language Generation with Little Data

Sublanguage: A Serious Issue Affects Pretrained Models in Legal Domain

A Comparative Study of Deep Learning Approaches for Arabic Language Processing

A Benchmark Evaluation of Multilingual Large Language Models for Arabic Cross-Lingual Named-Entity Recognition

BERT-Based Joint Model for Aspect Term Extraction and Aspect Polarity Detection in Arabic Text

SaudiBERT: A Large Language Model Pretrained on Saudi Dialect Corpora