Abstract:Text sentiment classification is an essential research field of natural language processing. Recently, numerous deep learning-based methods for sentiment classification have been proposed and achieved better performances compared with conventional machine learning methods. However, most of the proposed methods ignore the interactive relationship between contextual semantics and sentimental tendency while modeling their text representation. In this paper, we propose a novel Interactive Dual Attention Network (IDAN) model that aims to interactively learn the representation between contextual semantics and sentimental tendency information. Firstly, we design an algorithm that utilizes linguistic resources to obtain sentimental tendency information from text and then extract word embeddings from the BERT (Bidirectional Encoder Representations from Transformers) pretraining model as the embedding layer of IDAN. Next, we use two Bidirectional LSTM (BiLSTM) networks to learn the long-range dependencies of contextual semantics and sentimental tendency information, respectively. Finally, two types of attention mechanisms are implemented in IDAN. One is multihead attention, which is the next layer of BiLSTM and is used to learn the interactive relationship between contextual semantics and sentimental tendency information. The other is global attention that aims to make the model focus on the important parts of the sequence and generate the final representation for classification. These two attention mechanisms enable IDAN to interactively learn the relationship between semantics and sentimental tendency information and improve the classification performance. A large number of experiments on four benchmark datasets show that our IDAN model is superior to competitive methods. Moreover, both the result analysis and the attention weight visualization further demonstrate the effectiveness of our proposed method.

Targeted Sentiment Classification with Attentional Encoder Network.

Targeted Sentiment Classification Based On Attentional Encoding And Graph Convolutional Networks

Attention-Enhanced Connectionist Temporal Classification for Discrete Speech Emotion Recognition

A Relative Position Attention Network for Aspect-Based Sentiment Analysis

Attention Modeling for Targeted Sentiment

A Deep Neural Network Model for Target-based Sentiment Analysis.

Speech Emotion Recognition by Combining a Unified First-Order Attention Network with Data Balance

Transformation Networks for Target-Oriented Sentiment Classification

Attention-Emotion-Enhanced Convolutional LSTM for Sentiment Analysis.

Sentiment Classification Using Comprehensive Attention Recurrent Models

A Deep Network Model for Specific Target Sentiment Analysis

Attention Based LSTM for Target Dependent Sentiment Classification

Sentiment Lexicon Enhanced Neural Sentiment Classification

Aspect Level Sentiment Classification with Unbiased Attention and Target Enhanced Representations

Feature-enhanced Attention Network for Target-Dependent Sentiment Classification

Speech Emotion Recognition via an Attentive Time-Frequency Neural Network

Surrounding-Based Attention Networks for Aspect-Level Sentiment Classification

Interactive Dual Attention Network for Text Sentiment Classification

A Context-focused Attention Evolution Model for Aspect-based Sentiment Classification

Bi-LSTM Based on Attention Mechanism for Emotion Analysis

SAAN: A Sentiment-Aware Attention Network for Sentiment Analysis.