Abstract:Sentiment analysis (SA) detects people’s opinions from text engaging natural language processing (NLP) techniques. Recent research has shown that deep learning models, i.e., Convolutional Neural Network (CNN), Recurrent Neural Network (RNN), and Transformer-based provide promising results for recognizing sentiment. Nonetheless, CNN has the advantage of extracting high-level features by using convolutional and max-pooling layers; it cannot efficiently learn a sequence of correlations. At the same time, Bidirectional RNN uses two RNN directions to improve extracting long-term dependencies. However, it cannot extract local features in parallel, and Transformer-based like Bidirectional Encoder Representations from Transformers (BERT) are the computational resources needed to fine-tune, facing an overfitting problem on small datasets. This paper proposes a novel attention-based model that utilizes CNNs with LSTM (named ACL-SA). First, it applies a preprocessor to enhance the data quality and employ term frequency-inverse document frequency (TF-IDF) feature weighting and pre-trained Glove word embedding approaches to extract meaningful information from textual data. In addition, it utilizes CNN’s max-pooling to extract contextual features and reduce feature dimensionality. Moreover, it uses an integrated bidirectional LSTM to capture long-term dependencies. Furthermore, it applies the attention mechanism at the CNN’s output layer to emphasize each word’s attention level. To avoid overfitting, the Guasiannoise and GuasianDroupout are adopted as regularization. The model’s robustness is evaluated on four English standard datasets, i.e., Sentiment140, US-airline, Sentiment140-MV, SA4A with various performance matrices, and compared efficiency with existing baseline models and approaches. The experiment results show that the proposed method significantly outperforms the state-of-the-art models.

Clause Sentiment Identification Based on Convolutional Neural Network with Context Embedding

Utterance-Based Audio Sentiment Analysis Learned by a Parallel Combination of CNN and LSTM.

Text Sentiment Analysis Based on Convolutional Neural Network and Bidirectional LSTM Model.

A Convolutional Neural Network for Aspect Sentiment Classification

Sentiment Commonsense Induced Sequential Neural Networks for Sentiment Classification.

Multi-channel Convolutional Neural Network with Sentiment Information for Sentiment Classification

Linguistically Regularized LSTM for Sentiment Classification

Deep-Sentiment: Sentiment Analysis Using Ensemble of CNN and Bi-LSTM Models

ConvLSTMConv network: a deep learning approach for sentiment analysis in cloud computing

Multi-Task Learning Model Based on Multi-Scale CNN and LSTM for Sentiment Classification

A C-LSTM Neural Network for Text Classification

Aspect Sentiment Classification with Both Word-level and Clause-level Attention Networks.

Sentiment analysis incorporating convolutional neural network into hidden Markov model

Combining Vector Space Features and Convolution Neural Network for Text Sentiment Analysis.

Attention-Based CNN and Bi-LSTM Model Based on TF-IDF and GloVe Word Embedding for Sentiment Analysis

ALBERTC-CNN Based Aspect Level Sentiment Analysis

Sentiment Classification Using Convolutional Neural Networks

Sentiment analysis based on long short-term memory model

Improving sentiment analysis via sentence type classification using BiLSTM-CRF and CNN

Neural Sentiment Classification with User and Product Attention

Transformation Networks for Target-Oriented Sentiment Classification