Abstract:Sentiment analysis is designed to classify documents into a fixed number of pre-defined categories that represent different sentiments. Focusing on the limitation of insufficient training data, multi-task learning models based on deep learning have recently achieved significant progress in this field. In general, these models leverage multiple datasets annotated for different tasks to improve the performance on each individual dataset. The improvement is particularly evident on tasks with limited training data. However, most of these models suffer from two limitations. First, they use the final output of the hidden layer as the overall representation of the text, which initially loses a certain amount of semantic information. Second, although some of them utilize a certain gate mechanism to select shared features, some irrelevant shared features are erroneously used owing to polysemy. To address these two limitations, we integrate a pooling layer into a Bi-directional Recurrent Neural Network (BRNN) to extract semantic information comprehensively. We then apply the attention mechanism between shared layers and task-specific layers to identify the effective shared features, and propose an Attention-based Separate Pooling BRNN (ASP-BRNN) model. We conduct experiments to show the effectiveness of our models on four datasets (SST1, SST2, SUBJ, and IMDB), and the accuracy of our models increases steadily by approximately 0.5% for each model. It proves the effectiveness of every newly added component in solving the two problems. A further evaluation on eight datasets shows our proposed ASP-BRNN model outperforms current state-of-the-art models, such as ASP-MTL model (at least +0.2% on Electronics and at most +6.9% on IMDB), MT-ARC-II model (at least +0.2% on SST2 and at most +3.8% on DVDs).

Multi-Task Mutual Learning for Joint Sentiment Classification and Topic Detection

Hierarchical and Bidirectional Joint Multi-Task Classifiers for Natural Language Understanding

Multi-modal Sentiment and Emotion Joint Analysis with a Deep Attentive Multi-task Learning Model

SENTIMENT CLASSIFICATION THROUGH COLLABORATIVE MULTI-INPUT AND MULTI-TASK LEARNING

Multi-Task Learning Model Based on Multi-Scale CNN and LSTM for Sentiment Classification

Towards a One-stop Solution to Both Aspect Extraction and Sentiment Analysis Tasks with Neural Multi-task Learning.

Multi-task Learning for Multi-modal Emotion Recognition and Sentiment Analysis

A Multi-model Fusion Framework Based on Deep Learning for Sentiment Classification.

Multimodal Learning for Topic Sentiment Analysis in Microblogging

Multi-task Learning Using Variational Auto-Encoder for Sentiment Classification

A text guided multi-task learning network for multimodal sentiment analysis

Aspect-Level Sentiment Analysis of Customer Reviews Based on Neural Multi-task Learning

Multi-task Learning Using a Hybrid Representation for Text Classification.

Personalized Microblog Sentiment Classification Via Multi-Task Learning

Multi-task Semi-supervised Semantic Feature Learning for Classification

Improving Twitter Sentiment Classification Using Topic-Enriched Multi-Prototype Word Embeddings.

Multi-Task Multi-Head Attention Memory Network for Fine-Grained Sentiment Analysis.

DJMF: A Discriminative Joint Multi-Task Framework for Multimodal Sentiment Analysis Based on Intra- and Inter-Task Dynamics

Recurrent Neural Network with Pooling Operation and Attention Mechanism for Sentiment Analysis: A Multi-Task Learning Approach

Sentiment Classification in Customer Service Dialogue with Topic-Aware Multi-Task Learning