Abstract:Sentiment analysis (SA) detects people’s opinions from text engaging natural language processing (NLP) techniques. Recent research has shown that deep learning models, i.e., Convolutional Neural Network (CNN), Recurrent Neural Network (RNN), and Transformer-based provide promising results for recognizing sentiment. Nonetheless, CNN has the advantage of extracting high-level features by using convolutional and max-pooling layers; it cannot efficiently learn a sequence of correlations. At the same time, Bidirectional RNN uses two RNN directions to improve extracting long-term dependencies. However, it cannot extract local features in parallel, and Transformer-based like Bidirectional Encoder Representations from Transformers (BERT) are the computational resources needed to fine-tune, facing an overfitting problem on small datasets. This paper proposes a novel attention-based model that utilizes CNNs with LSTM (named ACL-SA). First, it applies a preprocessor to enhance the data quality and employ term frequency-inverse document frequency (TF-IDF) feature weighting and pre-trained Glove word embedding approaches to extract meaningful information from textual data. In addition, it utilizes CNN’s max-pooling to extract contextual features and reduce feature dimensionality. Moreover, it uses an integrated bidirectional LSTM to capture long-term dependencies. Furthermore, it applies the attention mechanism at the CNN’s output layer to emphasize each word’s attention level. To avoid overfitting, the Guasiannoise and GuasianDroupout are adopted as regularization. The model’s robustness is evaluated on four English standard datasets, i.e., Sentiment140, US-airline, Sentiment140-MV, SA4A with various performance matrices, and compared efficiency with existing baseline models and approaches. The experiment results show that the proposed method significantly outperforms the state-of-the-art models.

SES-Net: A Novel Multi-Task Deep Neural Network Model for Analyzing E-learning Users' Satisfaction via Sentiment, Emotion, and Semantic

A Novel Hybrid Machine Learning Model for Analyzing E-Learning Users’ Satisfaction

MultiSentiNet: A Deep Semantic Network for Multimodal Sentiment Analysis

A Deep Neural Network Model for Target-based Sentiment Analysis.

Deep Learning-Based Natural Language Processing Methods for Sentiment Analysis in Social Networks

YUN-HPCC at SemEval-2019 Task 3: Multi-Step Ensemble Neural Network for Sentiment Analysis in Textual Conversation

Artificial Intelligence Technology-Based Semantic Sentiment Analysis on Network Public Opinion Texts

Learning Semantic Representations of Users and Products for Document Level Sentiment Classification

Document-Level Sentiment Analysis Using Attention-Based Bi-Directional Long Short-Term Memory Network and Two-Dimensional Convolutional Neural Network

A supervised deep learning-based sentiment analysis by the implementation of Word2Vec and GloVe Embedding techniques

An Improved Model for Analyzing Textual Sentiment Based on a Deep Neural Network Using Multi-Head Attention Mechanism

User Multi-Modal Emotional Intelligence Analysis Method Based on Deep Learning in Social Network Big Data Environment

Recurrent Neural Network with Pooling Operation and Attention Mechanism for Sentiment Analysis: A Multi-Task Learning Approach

Student Public Opinion Management in Campus Commentary Based on Deep Learning

Attention-Based CNN and Bi-LSTM Model Based on TF-IDF and GloVe Word Embedding for Sentiment Analysis

Sentiment Analysis Using Deep Learning Approaches:An Overview

Sentiment Analysis and Sarcasm Detection using Deep Multi-Task Learning

SentiNet: A Robust and Multilingual Sentiment Analysis System with Transfer Learning and Adversarial Training Techniques

Sentiment Commonsense Induced Sequential Neural Networks for Sentiment Classification.

Multi-modality Weakly Labeled Sentiment Learning Based on Explicit Emotion Signal for Chinese Microblog.

Implicit sentiment analysis based on multi-feature neural network model