Abstract:Long short-term memory (LSTM) neural networks and attention mechanism have been widely used in sentiment representation learning and detection of texts. However, most of the existing deep learning models for text sentiment analysis ignore emotion's modulation effect on sentiment feature extraction, and the attention mechanisms of these deep neural network architectures are based on word- or sentence-level abstractions. Ignoring higher level abstractions may pose a negative effect on learning text sentiment features and further degrade sentiment classification performance. To address this issue, in this article, a novel model named AEC-LSTM is proposed for text sentiment detection, which aims to improve the LSTM network by integrating emotional intelligence (EI) and attention mechanism. Specifically, an emotion-enhanced LSTM, named ELSTM, is first devised by utilizing EI to improve the feature learning ability of LSTM networks, which accomplishes its emotion modulation of learning system via the proposed emotion modulator and emotion estimator. In order to better capture various structure patterns in text sequence, ELSTM is further integrated with other operations, including convolution, pooling, and concatenation. Then, topic-level attention mechanism is proposed to adaptively adjust the weight of text hidden representation. With the introduction of EI and attention mechanism, sentiment representation and classification can be more effectively achieved by utilizing sentiment semantic information hidden in text topic and context. Experiments on real-world data sets show that our approach can improve sentiment classification performance effectively and outperform state-of-the-art deep learning-based methods significantly.

An Attention-Aware Long Short-Term Memory-Like Spiking Neural Model for Sentiment Analysis

Sentiment classification using bidirectional LSTM-SNP model and attention mechanism

A Relative Position Attention Network for Aspect-Based Sentiment Analysis

Attention-enabled Gated Spiking Neural P Model for Aspect-Level Sentiment Classification

Aspect Level Sentiment Analysis with Aspect Attention.

Attention-based LSTM for Aspect-level Sentiment Classification.

Bilateral-brain-like Semantic and Syntactic Cognitive Network for Aspect-level Sentiment Analysis

LSTM-SNP: A long short-term memory model inspired from spiking neural P systems

Aspect-based sentiment analysis via bidirectional variant spiking neural P systems

Aspect-Level Sentiment Analysis Via a Syntax-Based Neural Network

Attention-Emotion-Enhanced Convolutional LSTM for Sentiment Analysis.

Sentiment Analysis Based on Attention Mechanisms and Bi-Directional LSTM Fusion Model.

Earlier Attention? Aspect-Aware LSTM for Aspect-Based Sentiment Analysis

A Deep Neural Network Model for Target-based Sentiment Analysis.

Gated Hierarchical LSTMs for Target-Based Sentiment Analysis.

Lexicon-Enhanced LSTM with Attention for General Sentiment Analysis.

Replicate, Walk, and Stop on Syntax: an Effective Neural Network Model for Aspect-Level Sentiment Classification

Multi-Level Attentional Network for Aspect-based Sentiment Analysis

Content Attention Model for Aspect Based Sentiment Analysis

An efficient sentiment analysis methodology based on long short-term memory networks

A Sparse Self-Attention Enhanced Model for Aspect-Level Sentiment Classification