Abstract:In today's modern society, social media has seamlessly integrated into our daily routines, providing a platform for individuals to express their opinions and emotions openly on the internet. Within this digital domain, sentiment analysis (SA) is a vital tool to understand the emotions conveyed in written text, whether positive, negative, or neutral. However, SA faces challenges such as dealing with diverse language, uneven data, and understanding complex sentences. This study proposes an effective approach for SA. For this, we introduce a hybrid architecture named DistilRoBiLSTMFuse, designed to extract deep contextual information from complex sentences and accurately identify sentiments. In this research, we evaluate our model's performance using two popular benchmark datasets: IMDb and Twitter USAirline sentiment. The raw text data are preprocessed, and this involves several steps, including: (1) implementing a comprehensive data cleaning protocol to remove noise and unnecessary information from the raw text, (2) preparing a custom list of stopwords to retain essential words while omitting common, non-informative words, and (3) applying Lemmatization to achieve consistency in text by reducing words to their base forms, enhancing the accuracy of text analysis. To address class imbalance, this study utilized oversampling, augmenting minority class samples to match the majority, thereby ensuring uniform representation across all categories. Considering the variability in preprocessing techniques across previous studies, our research initially explores the efficacy of seven distinct machine learning (ML) models paired with two commonly employed feature transformation methods: term frequency-inverse document frequency (TF-IDF) and bag of words (BoW). This approach allows for determining which combination yields optimal performance within these ML frameworks. In our study, the DistilRoBiLSTMFuse model is evaluated on two distinct datasets and consistently delivers outstanding performance, surpassing existing state-of-the-art approaches in each case. On the IMDb dataset, our model achieves 98.91% accuracy in training, 94.16% in validation, and 93.97% in testing. The Twitter USAirline Sentiment dataset reaches 99.42% accuracy in training, 98.52% in validation, and 98.33% in testing. The experimental results clearly demonstrate the effectiveness of our hybrid DistilRoBiLSTMFuse model in SA tasks. The code for this experimental analysis is publicly available and can be accessed via the following DOI: https://doi.org/10.5281/zenodo.13255008.

Real-time topic-based sentiment analysis for movie tweets using hybrid approach

Hybrid convolutional bidirectional recurrent neural network based sentiment analysis on movie reviews

A Hybrid CNN-LSTM Model for Improving Accuracy of Movie Reviews Sentiment Analysis

A Deep Neural Network-Based Approach for Sentiment Analysis of Movie Reviews

Proposing sentiment analysis model based on BERT and XLNet for movie reviews

Scalable deep learning framework for sentiment analysis prediction for online movie reviews

DistilRoBiLSTMFuse: an efficient hybrid deep learning approach for sentiment analysis

An Emotion based Sentiment Analysis on Twitter Dataset

Deep learning-based sentiment analysis of movie reviews

Hybrid Deep Learning Approach for Sentiment Analysis on Twitter Data

Transformer-based deep learning models for the sentiment analysis of social media data

Implementing Sentiment Analysis on Real-Time Twitter Data

Sentiment Analysis Using Machine Learning Approaches (Lexicon based on movie review dataset)

Optimization driven actor-critic neural network for sentiment analysis in social media

Sentiment analysis of movie reviews based on NB approaches using TF–IDF and count vectorizer

Performing Sentiment Analysis with the Proposed Artificial Intelligence-Based Method Using Movie Commentaries

Sentiment Analysis on Movie Reviews

Sentiment analysis of movie reviews based on deep learning

DL based analysis of movie reviews

Sentiment Analysis of Persian Movie Reviews Using Deep Learning

Deep Learning and Imbalance Handling on Movie Review Sentiment Analysis