Abstract:Text sentiment classification is an essential research field of natural language processing. Recently, numerous deep learning-based methods for sentiment classification have been proposed and achieved better performances compared with conventional machine learning methods. However, most of the proposed methods ignore the interactive relationship between contextual semantics and sentimental tendency while modeling their text representation. In this paper, we propose a novel Interactive Dual Attention Network (IDAN) model that aims to interactively learn the representation between contextual semantics and sentimental tendency information. Firstly, we design an algorithm that utilizes linguistic resources to obtain sentimental tendency information from text and then extract word embeddings from the BERT (Bidirectional Encoder Representations from Transformers) pretraining model as the embedding layer of IDAN. Next, we use two Bidirectional LSTM (BiLSTM) networks to learn the long-range dependencies of contextual semantics and sentimental tendency information, respectively. Finally, two types of attention mechanisms are implemented in IDAN. One is multihead attention, which is the next layer of BiLSTM and is used to learn the interactive relationship between contextual semantics and sentimental tendency information. The other is global attention that aims to make the model focus on the important parts of the sequence and generate the final representation for classification. These two attention mechanisms enable IDAN to interactively learn the relationship between semantics and sentimental tendency information and improve the classification performance. A large number of experiments on four benchmark datasets show that our IDAN model is superior to competitive methods. Moreover, both the result analysis and the attention weight visualization further demonstrate the effectiveness of our proposed method.

SAAN: A Sentiment-Aware Attention Network for Sentiment Analysis.

A Relative Position Attention Network for Aspect-Based Sentiment Analysis

LAAN: A Linguistic-Aware Attention Network for Sentiment Analysis

S2SAN: A sentence-to-sentence attention network for sentiment analysis of online reviews

A Multi-sentiment-resource Enhanced Attention Network for Sentiment Classification

A Lexicon-Based Supervised Attention Model for Neural Sentiment Analysis.

Attention-Based CNN and Bi-LSTM Model Based on TF-IDF and GloVe Word Embedding for Sentiment Analysis

Self-Attention Networks and Adaptive Support Vector Machine for aspect-level sentiment classification

Sentiment Lexicon Enhanced Attention-Based LSTM for Sentiment Classification

Multi-Task Multi-Head Attention Memory Network for Fine-Grained Sentiment Analysis.

Sentence Constituent-Aware Aspect-Category Sentiment Analysis with Graph Attention Networks

Multi-Aspect Sentiment Analysis with Latent Sentiment-Aspect Attribution

Feature-enhanced Attention Network for Target-Dependent Sentiment Classification

High accuracy offering attention mechanisms based deep learning approach using CNN/bi-LSTM for sentiment analysis

A Deep Multi-Level Attentive network for Multimodal Sentiment Analysis

Visual Sentiment Analysis With Social Relations-Guided Multiattention Networks

Analyzing multimodal public sentiment based on hierarchical semantic attentional network

AMR-based Network for Aspect-based Sentiment Analysis.

Interactive Dual Attention Network for Text Sentiment Classification

Artificial Intelligence Technology-Based Semantic Sentiment Analysis on Network Public Opinion Texts

Sentiment Lexicon Enhanced Neural Sentiment Classification