Abstract:The emergence of deep learning as a commanding technique for learning heterogeneous layers of feature representations have consequently substituted traditional machine learning algorithms which are generally poor in analyzing compound sentences. Additionally, convolutional and recurrent neural networks have auspiciously yielded state-of-the-art results in sentiment classification and Natural Language Processing (NLP). In this paper, a deep sentiment representation model through the combination of multiple Convolutional Neural Networks (CNN) kernels with Long Short-Term Memory (LSTM) is proposed for sentiment classification. Our model gains word vector representation using pre-trained Global Vectors for Word Representation (GloVe) embeddings, thereafter used as input to the CNN layer which extracts higher local text representations. Finally, Bidirectional LSTM (biLSTM) generates sentiment classification of sentence representation based on context dependent features. Our combined approach of CNN and biLSTM was experimented using the Stanford Large Movie Review Dataset (IMDB) and Stanford Sentiment Treebank Dataset (SSTB) for binary classification. The evaluation achieves outstanding results in outperforming several existing approaches with 90.4% accuracy on the Stanford Sentiment Treebank dataset and 94.8% accuracy on the Stanford Large Movie Review dataset. These results are achieved with a drastic reduction of model parameters and without a pooling layer in the CNN architecture, helping to retain local and structural information in comparison to other existing deep neural network frameworks.

Combining Convolution and Recursive Neural Networks for Sentiment Analysis

Utterance-Based Audio Sentiment Analysis Learned by a Parallel Combination of CNN and LSTM.

Sentiment Lexical-Augmented Convolutional Neural Networks for Sentiment Analysis.

Adaptive Multi-Compositionality For Recursive Neural Models With Applications To Sentiment Analysis

Tree-based Convolution for Sentence Modeling.

Sequential Multi-Kernel Convolutional Recurrent Network for Sentiment Classification

Combination of Domain Knowledge and Deep Learning for Sentiment Analysis of Short and Informal Messages on Social Media

Combining Vector Space Features and Convolution Neural Network for Text Sentiment Analysis.

Dependency-based Convolutional Neural Networks for Sentence Embedding

Deep Sentiment Representation Based on CNN and LSTM

Parallel Recursive Deep Model for Sentiment Analysis

A Deep Neural Network Model for Target-based Sentiment Analysis.

Text Sentiment Analysis Based on Convolutional Neural Network and Bidirectional LSTM Model.

Combining Attention-Based Bidirectional Gated Recurrent Neural Network and Two-Dimensional Convolutional Neural Network for Document-Level Sentiment Classification

Recursive Deep Learning for Sentiment Analysis over Social Data

Encoding Syntactic Knowledge in Neural Networks for Sentiment Classification.

Combining Neural Networks and Log-linear Models to Improve Relation Extraction

Aspect-Level Sentiment Analysis Via Convolution over Dependency Tree

A Deep Neural Architecture for Sentence-level Sentiment Classification in Twitter Social Networking

Learning Tag Embeddings and Tag-specific Composition Functions in Recursive Neural Network.

Tree Communication Models for Sentiment Analysis