Abstract:Text sentiment classification is an essential research field of natural language processing. Recently, numerous deep learning-based methods for sentiment classification have been proposed and achieved better performances compared with conventional machine learning methods. However, most of the proposed methods ignore the interactive relationship between contextual semantics and sentimental tendency while modeling their text representation. In this paper, we propose a novel Interactive Dual Attention Network (IDAN) model that aims to interactively learn the representation between contextual semantics and sentimental tendency information. Firstly, we design an algorithm that utilizes linguistic resources to obtain sentimental tendency information from text and then extract word embeddings from the BERT (Bidirectional Encoder Representations from Transformers) pretraining model as the embedding layer of IDAN. Next, we use two Bidirectional LSTM (BiLSTM) networks to learn the long-range dependencies of contextual semantics and sentimental tendency information, respectively. Finally, two types of attention mechanisms are implemented in IDAN. One is multihead attention, which is the next layer of BiLSTM and is used to learn the interactive relationship between contextual semantics and sentimental tendency information. The other is global attention that aims to make the model focus on the important parts of the sequence and generate the final representation for classification. These two attention mechanisms enable IDAN to interactively learn the relationship between semantics and sentimental tendency information and improve the classification performance. A large number of experiments on four benchmark datasets show that our IDAN model is superior to competitive methods. Moreover, both the result analysis and the attention weight visualization further demonstrate the effectiveness of our proposed method.

Interactive capsule network for implicit sentiment analysis

Chinese Implicit Sentiment Analysis based on Hybrid Neural Networks

Bridging the Emotional Semantic Gap via Multimodal Relevance Estimation

Aspect-Level Sentiment Classification Based on Self-Attention Routing Via Capsule Network.

Implicit sentiment analysis based on multi-feature neural network model

Dynamic commonsense knowledge fused method for Chinese implicit sentiment analysis

Chat-Capsule: A Hierarchical Capsule for Dialog-level Emotion Analysis

Interactive POS-aware network for aspect-level sentiment classification

Interactive Dual Attention Network for Text Sentiment Classification

Sentiment Analysis of Online Travel Reviews Based on Capsule Network and Sentiment Lexicon

Aspect-level Sentiment Analysis Using AS-Capsules

Targeted Aspect-Based Multimodal Sentiment Analysis: An Attention Capsule Extraction and Multi-Head Fusion Network

Interactive Attention Networks for Aspect-Level Sentiment Classification

Discovering Protagonist of Sentiment with Aspect Reconstructed Capsule Network

A Multimodal Sentiment Analysis Approach Based on a Joint Chained Interactive Attention Mechanism

Sc-Bicapsnet: A Sentiment Classification Model Based On Bi-Channel Capsule Network

Effective inter-aspect words modeling for aspect-based sentiment analysis

Implicit Sentiment Analysis of Chinese Texts based on Contextual Information and Knowledge Enhancement

Multi-Interactive Memory Network for Aspect Based Multimodal Sentiment Analysis

A Contextual Attention Network for Multimodal Emotion Recognition in Conversation