Abstract:In today's modern society, social media has seamlessly integrated into our daily routines, providing a platform for individuals to express their opinions and emotions openly on the internet. Within this digital domain, sentiment analysis (SA) is a vital tool to understand the emotions conveyed in written text, whether positive, negative, or neutral. However, SA faces challenges such as dealing with diverse language, uneven data, and understanding complex sentences. This study proposes an effective approach for SA. For this, we introduce a hybrid architecture named DistilRoBiLSTMFuse, designed to extract deep contextual information from complex sentences and accurately identify sentiments. In this research, we evaluate our model's performance using two popular benchmark datasets: IMDb and Twitter USAirline sentiment. The raw text data are preprocessed, and this involves several steps, including: (1) implementing a comprehensive data cleaning protocol to remove noise and unnecessary information from the raw text, (2) preparing a custom list of stopwords to retain essential words while omitting common, non-informative words, and (3) applying Lemmatization to achieve consistency in text by reducing words to their base forms, enhancing the accuracy of text analysis. To address class imbalance, this study utilized oversampling, augmenting minority class samples to match the majority, thereby ensuring uniform representation across all categories. Considering the variability in preprocessing techniques across previous studies, our research initially explores the efficacy of seven distinct machine learning (ML) models paired with two commonly employed feature transformation methods: term frequency-inverse document frequency (TF-IDF) and bag of words (BoW). This approach allows for determining which combination yields optimal performance within these ML frameworks. In our study, the DistilRoBiLSTMFuse model is evaluated on two distinct datasets and consistently delivers outstanding performance, surpassing existing state-of-the-art approaches in each case. On the IMDb dataset, our model achieves 98.91% accuracy in training, 94.16% in validation, and 93.97% in testing. The Twitter USAirline Sentiment dataset reaches 99.42% accuracy in training, 98.52% in validation, and 98.33% in testing. The experimental results clearly demonstrate the effectiveness of our hybrid DistilRoBiLSTMFuse model in SA tasks. The code for this experimental analysis is publicly available and can be accessed via the following DOI: https://doi.org/10.5281/zenodo.13255008.

Effectiveness of a Light-Weight Ice-Vest for Body Cooling While Wearing Fire Fighter’s Protective Clothing in the Heat

RoBERTa-BiLSTM: A Context-Aware Hybrid Model for Sentiment Analysis

RoBERTa-LSTM: A Hybrid Model for Sentiment Analysis With Transformer and Recurrent Neural Network

Sentiment analysis classification system using hybrid BERT models

Sentiment Analysis of Text Reviews Using Lexicon-Enhanced Bert Embedding (LeBERT) Model with Convolutional Neural Network

RoBERTa, ResNeXt and BiLSTM with self-attention: The ultimate trio for customer sentiment analysis

Research on sentiment classification for netizens based on the BERT-BiLSTM-TextCNN model

DistilRoBiLSTMFuse: an efficient hybrid deep learning approach for sentiment analysis

Fine-Tuning BERT Based Approach for Multi-Class Sentiment Analysis on Twitter Emotion Data

[Modeling of Cs-137 vertical soil transfer by a tree root system].

A Hybrid CNN-LSTM Model for Improving Accuracy of Movie Reviews Sentiment Analysis

Transformer-based deep learning models for the sentiment analysis of social media data

An improved aspect-category sentiment analysis model for text sentiment analysis based on RoBERTa

ArabBert-LSTM: improving Arabic sentiment analysis based on transformer model and Long Short-Term Memory

Hybrid Models for Emotion Classification and Sentiment Analysis in Indonesian Language

Transfer Learning for Sentiment Classification Using Bidirectional Encoder Representations from Transformers (BERT) Model

A Hybrid Transformer and Attention Based Recurrent Neural Network for Robust and Interpretable Sentiment Analysis of Tweets

TopicBERT: A Topic-Enhanced Neural Language Model Fine-Tuned for Sentiment Classification

High-throughput proteome dynamics for discovery of key proteins in sentinel species: Unsuspected vitellogenins diversity in the crustacean Gammarus fossarum.

BERT-Based Combination of Convolutional and Recurrent Neural Network for Indonesian Sentiment Analysis

Scalable deep learning framework for sentiment analysis prediction for online movie reviews