Abstract:Long short-term memory (LSTM) neural networks and attention mechanism have been widely used in sentiment representation learning and detection of texts. However, most of the existing deep learning models for text sentiment analysis ignore emotion's modulation effect on sentiment feature extraction, and the attention mechanisms of these deep neural network architectures are based on word- or sentence-level abstractions. Ignoring higher level abstractions may pose a negative effect on learning text sentiment features and further degrade sentiment classification performance. To address this issue, in this article, a novel model named AEC-LSTM is proposed for text sentiment detection, which aims to improve the LSTM network by integrating emotional intelligence (EI) and attention mechanism. Specifically, an emotion-enhanced LSTM, named ELSTM, is first devised by utilizing EI to improve the feature learning ability of LSTM networks, which accomplishes its emotion modulation of learning system via the proposed emotion modulator and emotion estimator. In order to better capture various structure patterns in text sequence, ELSTM is further integrated with other operations, including convolution, pooling, and concatenation. Then, topic-level attention mechanism is proposed to adaptively adjust the weight of text hidden representation. With the introduction of EI and attention mechanism, sentiment representation and classification can be more effectively achieved by utilizing sentiment semantic information hidden in text topic and context. Experiments on real-world data sets show that our approach can improve sentiment classification performance effectively and outperform state-of-the-art deep learning-based methods significantly.

A Deep Network Model for Specific Target Sentiment Analysis

A Deep Neural Network Model for Target-based Sentiment Analysis.

Utterance-Based Audio Sentiment Analysis Learned by a Parallel Combination of CNN and LSTM.

Gated Hierarchical LSTMs for Target-Based Sentiment Analysis.

Attention-Emotion-Enhanced Convolutional LSTM for Sentiment Analysis.

Attention Modeling for Targeted Sentiment

Deep Sentiment Representation Based on CNN and LSTM

Sentiment analysis based on long short-term memory model

A P-LSTM Neural Network for Sentiment Classification.

Affection Driven Neural Networks for Sentiment Analysis.

Effective LSTMs for Target-Dependent Sentiment Classification

Transformation Networks for Target-Oriented Sentiment Classification

Text Sentiment Analysis Based on Convolutional Neural Network and Bidirectional LSTM Model.

Multi-layer Attention Based CNN for Target-Dependent Sentiment Classification

A Variant of Recurrent Entity Networks for Targeted Aspect-Based Sentiment Analysis.

A Multi-Classification Sentiment Analysis Model of Chinese Short Text Based on Gated Linear Units and Attention Mechanism

A Deep Neural Network Approach using Convolutional Network and Long Short Term Memory for Text Sentiment Classification

Research on Chinese Sentiment Analysis Based on Bi-LSTM Networks

An Attention-Aware Long Short-Term Memory-Like Spiking Neural Model for Sentiment Analysis

An emotional classification method based on joint deep learning model

Targeted Sentiment Classification with Attentional Encoder Network.