Abstract:Due to the rapid development of technology, social media has become more and more common in human daily life. Social media is a platform for people to express their feelings, feedback, and opinions. To understand the sentiment context of the text, sentiment analysis plays the role to determine whether the sentiment of the text is positive, negative, neutral or any other personal feeling. Sentiment analysis is prominent from the perspective of business or politics where it highly impacts the strategic decision making. The challenges of sentiment analysis are attributable to the lexical diversity, imbalanced dataset and long-distance dependencies of the texts. In view of this, a data augmentation technique with GloVe word embedding is leveraged to synthesize more lexically diverse samples by similar word vector replacements. The data augmentation also focuses on the oversampling of the minority classes to mitigate the imbalanced dataset problems. Apart from that, the existing sentiment analysis mostly leverages sequence models to encode the long-distance dependencies. Nevertheless, the sequence models require a longer execution time as the processing is done sequentially. On the other hand, the Transformer models require less computation time with parallelized processing. To that end, this paper proposes a hybrid deep learning method that combines the strengths of sequence model and Transformer model while suppressing the limitations of sequence model. Specifically, the proposed model integrates Robustly optimized BERT approach and Long Short-Term Memory for sentiment analysis. The Robustly optimized BERT approach maps the words into a compact meaningful word embedding space while the Long Short-Term Memory model captures the long-distance contextual semantics effectively. The experimental results demonstrate that the proposed hybrid model outshines the state-of-the-art methods by achieving F1-scores of 93%, 91%, and 90% on IMDb dataset, Twitter US Airline Sentiment dataset, and Sentiment140 dataset, respectively.

Recognizing Emotions from Texts Using an Ensemble of Transformer-Based Language Models

Recognizing Emotions from Texts Using a Bert-Based Approach

Comparative Analyses of Bert, Roberta, Distilbert, and Xlnet for Text-Based Emotion Recognition

Self-attention Transfer Networks for Speech Emotion Recognition

Transformer models for text-based emotion detection: a review of BERT-based approaches

Improving the Generalizability of Text-Based Emotion Detection by Leveraging Transformers with Psycholinguistic Features

Transformer based ensemble for emotion detection

Emotion-Aware Transformer Encoder for Empathetic Dialogue Generation

Emotion Recognition on Social Media Using Natural Language Processing (NLP) Techniques

Emotion Classification In Software Engineering Texts: A Comparative Analysis of Pre-trained Transformers Language Models

Personalized Speech Emotion Recognition in Human-Robot Interaction using Vision Transformers

Decoding Emotions: A comprehensive Multilingual Study of Speech Models for Speech Emotion Recognition

Transformer based neural networks for emotion recognition in conversations

Transformer Based Multimodal Speech Emotion Recognition with Improved Neural Networks

Modulated Fusion using Transformer for Linguistic-Acoustic Emotion Recognition

Emotion Recognition Using Transformers with Masked Learning

Human–Computer Interaction with a Real-Time Speech Emotion Recognition with Ensembling Techniques 1D Convolution Neural Network and Attention

Emotion Recognition in Social Network Texts Based on A Multilingual Architecture

Towards Emotion Recognition in Hindi-English Code-Mixed Data: A Transformer Based Approach

A Simple and Interactive Transformer for Fine-Grained Emotion Detection

RoBERTa-LSTM: A Hybrid Model for Sentiment Analysis With Transformer and Recurrent Neural Network