Abstract:Text sentiment classification is an essential research field of natural language processing. Recently, numerous deep learning-based methods for sentiment classification have been proposed and achieved better performances compared with conventional machine learning methods. However, most of the proposed methods ignore the interactive relationship between contextual semantics and sentimental tendency while modeling their text representation. In this paper, we propose a novel Interactive Dual Attention Network (IDAN) model that aims to interactively learn the representation between contextual semantics and sentimental tendency information. Firstly, we design an algorithm that utilizes linguistic resources to obtain sentimental tendency information from text and then extract word embeddings from the BERT (Bidirectional Encoder Representations from Transformers) pretraining model as the embedding layer of IDAN. Next, we use two Bidirectional LSTM (BiLSTM) networks to learn the long-range dependencies of contextual semantics and sentimental tendency information, respectively. Finally, two types of attention mechanisms are implemented in IDAN. One is multihead attention, which is the next layer of BiLSTM and is used to learn the interactive relationship between contextual semantics and sentimental tendency information. The other is global attention that aims to make the model focus on the important parts of the sequence and generate the final representation for classification. These two attention mechanisms enable IDAN to interactively learn the relationship between semantics and sentimental tendency information and improve the classification performance. A large number of experiments on four benchmark datasets show that our IDAN model is superior to competitive methods. Moreover, both the result analysis and the attention weight visualization further demonstrate the effectiveness of our proposed method.

Identifying Implicit Polarity of Events by Using an Attention-Based Neural Network Model.

A Relative Position Attention Network for Aspect-Based Sentiment Analysis

Chinese Implicit Sentiment Analysis based on Hybrid Neural Networks

Implicit sentiment analysis based on affective knowledge and event information

Implicit sentiment analysis based on multi-feature neural network model

BiLSTM with Multi-Polarity Orthogonal Attention for Implicit Sentiment Analysis

A message-passing multi-task architecture for the implicit event and polarity detection

Interactive Dual Attention Network for Text Sentiment Classification

Attention-Based Modality-Gated Networks for Image-Text Sentiment Analysis

Attention-based multi-level image and text sentiment analysis

Attention-Based BiLSTM Network with Lexical Feature for Emotion Classification

Examining Attention Mechanisms in Deep Learning Models for Sentiment Analysis

Co-attention Network and Low-rank Bilinear Pooling for Aspect Based Sentiment Analysis

A Lexicon-Based Supervised Attention Model for Neural Sentiment Analysis.

Sentiment Commonsense Induced Sequential Neural Networks for Sentiment Classification.

Sentiment Lexicon Enhanced Neural Sentiment Classification

Interactive Attention Networks for Aspect-Level Sentiment Classification

Sentiment classification using bidirectional LSTM-SNP model and attention mechanism

of parent material, mining and agriculture on groundwater composition in the Strumica valley, Macedonia

Aspect-based sentiment analysis with alternating coattention networks