Abstract:Microblog sentiment prediction has attracted extensive research focus with wide application prospects. With the increasing proportion of multimodal tweets composing of images, texts and emoticons, new challenges have been raised to the existing sentiment prediction schemes. More crucially, it remains an open problem to model the dependency among multiple modalities, where one or more modalities may be missing. In this paper, we present a novel Bi-layer Multimodal Hypergraph learning (termed Bi-MHG) towards robust sentiment prediction of multimodal tweets to tackle the above challenges. In particular, we design a two-layer structure for the proposed Bi-MHG model: The first layer, i.e., a tweet-level hypergraph learns the tweet-feature correlation and the tweet relevance to predict the sentiments of unlabeled tweets. The second layer, i.e., a featurelevel hypergraph learns the relevance among different feature modalities (including the mid-level visual features in Sentibank [1]) by leveraging prior multimodal sentiment dictionaries. These two layers are connected by sharing the relevance of multimodal features in a unified bi-layer learning scheme. In such a way, Bi-MHG explicitly models the modality relevance rather than implicitly weighting multimodal features adopted in the existing Multimodal Hypergraph learning [2]. Finally, a nested alternating optimization is further proposed for Bi-MHG parameter learning. We have carried out extensive evaluations on a realworld microblog dataset crawled from Sina Weibo. For the task of multimodal sentiment prediction, superior performance is reported over several state-of-the-art and alternative approaches, which demonstrates the merits of the proposed scheme.

A Bilingual Lexicon-Based Multi-class Semantic Orientation Analysis for Microblogs

Lexicon-Based Sentiment Analysis on Topical Chinese Microblog Messages.

Sentiment Classification in Chinese Microblogs: Lexicon-based and Learning-based Approaches

Multi-view sentiment classification of microblogs based on semantic features

A Multi-dimension and Multi-granularity Feature Fusion Method for Chinese Microblog Sentiment Classification

Towards Building a High-Quality Microblog-Specific Chinese Sentiment Lexicon.

Sentiment Analysis of Chinese Micro-blogs Based on Emoticons and Emotional Words

Every Term Has Sentiment: Learning from Emoticon Evidences for Chinese Microblog Sentiment Analysis

Sentiment Analysis on Microblogging by Integrating Text and Image Features

Chinese Micro-Blog Emotion Classification By Exploiting Linguistic Features And Svmperf

Hierarchical Structure Based Hybrid Approach to Sentiment Analysis of Chinese Micro Blog and Its Feature Extraction

Chinese Microblog Topic Detection through POS-Based Semantic Expansion

A Joint Model for Chinese Microblog Sentiment Analysis.

Chinese Micro-Blog Emotion Classification by Exploiting Linguistic Features and SVM $$^{\Textit{perf}}$$

Social Media Opinion Summarization Using Emotion Cognition and Convolutional Neural Networks

Microblog User Emotion Analysis Method Based on Improved Hierarchical Attention Mechanism and BiLSTM

Microblog Sentiment Classification with Heterogeneous Sentiment Knowledge

Word Dictionary Emoticon Dictionary SentiBank : ANP Detector Library Microblog with labeled sentiment Testing microblogs Update Update W Update g

A Novel Emotion Lexicon for Chinese Emotional Expression Analysis on Weibo: Using Grounded Theory and Semi-Automatic Methods

A Sentiment Classification Method of Web Social Media Based on Multidimensional and Multilevel Modeling

A multi-label classification based approach for sentiment classification