Abstract:Text sentiment classification is an essential research field of natural language processing. Recently, numerous deep learning-based methods for sentiment classification have been proposed and achieved better performances compared with conventional machine learning methods. However, most of the proposed methods ignore the interactive relationship between contextual semantics and sentimental tendency while modeling their text representation. In this paper, we propose a novel Interactive Dual Attention Network (IDAN) model that aims to interactively learn the representation between contextual semantics and sentimental tendency information. Firstly, we design an algorithm that utilizes linguistic resources to obtain sentimental tendency information from text and then extract word embeddings from the BERT (Bidirectional Encoder Representations from Transformers) pretraining model as the embedding layer of IDAN. Next, we use two Bidirectional LSTM (BiLSTM) networks to learn the long-range dependencies of contextual semantics and sentimental tendency information, respectively. Finally, two types of attention mechanisms are implemented in IDAN. One is multihead attention, which is the next layer of BiLSTM and is used to learn the interactive relationship between contextual semantics and sentimental tendency information. The other is global attention that aims to make the model focus on the important parts of the sequence and generate the final representation for classification. These two attention mechanisms enable IDAN to interactively learn the relationship between semantics and sentimental tendency information and improve the classification performance. A large number of experiments on four benchmark datasets show that our IDAN model is superior to competitive methods. Moreover, both the result analysis and the attention weight visualization further demonstrate the effectiveness of our proposed method.

Attention Based LSTM for Target Dependent Sentiment Classification

Effective LSTMs for Target-Dependent Sentiment Classification

Residual attention and other aspects module for aspect-based sentiment analysis

A Relative Position Attention Network for Aspect-Based Sentiment Analysis

Sentiment classification using bidirectional LSTM-SNP model and attention mechanism

Sentiment Lexicon Enhanced Attention-Based LSTM for Sentiment Classification

Attention-Enhanced Connectionist Temporal Classification for Discrete Speech Emotion Recognition

Gated Hierarchical LSTMs for Target-Based Sentiment Analysis.

Attention-based LSTM for Aspect-level Sentiment Classification.

Effective Strategies for Combining Attention Mechanism with LSTM for Aspect-Level Sentiment Classification

A Bi-Directional LSTM-CNN Model with Attention for Aspect-Level Text Classification

Learning Latent Opinions for Aspect-level Sentiment Classification

Aspect-based sentiment analysis with alternating coattention networks

Target-Based Attention Model For Aspect-Level Sentiment Analysis

Transformation Networks for Target-Oriented Sentiment Classification

Feature-enhanced Attention Network for Target-Dependent Sentiment Classification

TDAM: a Topic-Dependent Attention Model for Sentiment Analysis

A Convolutional Stacked Bidirectional LSTM with a Multiplicative Attention Mechanism for Aspect Category and Sentiment Detection

Interactive Dual Attention Network for Text Sentiment Classification

Bidirectional LSTM with attention mechanism and convolutional layer for text classification

Target-oriented Sentiment Classification with Sequential Cross-modal Semantic Graph