Abstract:Text sentiment classification is an essential research field of natural language processing. Recently, numerous deep learning-based methods for sentiment classification have been proposed and achieved better performances compared with conventional machine learning methods. However, most of the proposed methods ignore the interactive relationship between contextual semantics and sentimental tendency while modeling their text representation. In this paper, we propose a novel Interactive Dual Attention Network (IDAN) model that aims to interactively learn the representation between contextual semantics and sentimental tendency information. Firstly, we design an algorithm that utilizes linguistic resources to obtain sentimental tendency information from text and then extract word embeddings from the BERT (Bidirectional Encoder Representations from Transformers) pretraining model as the embedding layer of IDAN. Next, we use two Bidirectional LSTM (BiLSTM) networks to learn the long-range dependencies of contextual semantics and sentimental tendency information, respectively. Finally, two types of attention mechanisms are implemented in IDAN. One is multihead attention, which is the next layer of BiLSTM and is used to learn the interactive relationship between contextual semantics and sentimental tendency information. The other is global attention that aims to make the model focus on the important parts of the sequence and generate the final representation for classification. These two attention mechanisms enable IDAN to interactively learn the relationship between semantics and sentimental tendency information and improve the classification performance. A large number of experiments on four benchmark datasets show that our IDAN model is superior to competitive methods. Moreover, both the result analysis and the attention weight visualization further demonstrate the effectiveness of our proposed method.

Explicit Interaction Model towards Text Classification

Database Systems for Advanced Applications

A simple and efficient text matching model based on deep interaction

A text classification network model combining machine learning and deep learning

Incorporating Knowledge into Neural Network for Text Representation.

Deep Fusion LSTMs for Text Semantic Matching.

An Intention Multiple-Representation Model with Expanded Information

HAIN: Multi-label Classification with Hierarchical Attention-based Interaction Network for Multi-turn Dialogue Texts

Comprehensive Implementation of TextCNN for Enhanced Collaboration between Natural Language Processing and System Recommendation

Integrated Model Text Classification Based on Multineural Networks

A Unified Understanding of Deep NLP Models for Text Classification

Short text matching model with multiway semantic interaction based on multi-granularity semantic embedding

A Multi-interaction Model with Cross-Branch Feature Fusion for Video-Text Retrieval.

Feature-Enhanced Nonequilibrium Bidirectional Long Short-Term Memory Model for Chinese Text Classification

Chinese text classification based on attention mechanism and feature-enhanced fusion neural network

Feature-enhanced text-inception model for Chinese long text classification

Enhancing Chinese Intent Classification by Dynamically Integrating Character Features into Word Embeddings with Ensemble Techniques

Adaptive Region Embedding for Text Classification.

Text Classification: A Perspective of Deep Learning Methods

Interactive Dual Attention Network for Text Sentiment Classification