Abstract:Social media users articulate their opinions on a broad spectrum of subjects and share their experiences through posts comprising multiple modes of expression, leading to a notable surge in such multimodal content on social media platforms. Nonetheless, accurately forecasting the popularity of these posts presents a considerable challenge. Prevailing methodologies primarily center on the content itself, thereby overlooking the wealth of information encapsulated within alternative modalities such as visual demographics, sentiments conveyed through hashtags and adequately modeling the intricate relationships among hashtags, texts, and accompanying images. This oversight limits the ability to capture emotional connection and audience relevance, significantly influencing post popularity. To address these limitations, we propose a seNtiment and hAshtag-aware attentive deep neuRal netwoRk for multimodAl posT pOpularity pRediction, herein referred to as NARRATOR that extracts visual demographics from faces appearing in images and discerns sentiment from hashtag usage, providing a more comprehensive understanding of the factors influencing post popularity Moreover, we introduce a hashtag-guided attention mechanism that leverages hashtags as navigational cues, guiding the models focus toward the most pertinent features of textual and visual modalities, thus aligning with target audience interests and broader social media context. Experimental results demonstrate that NARRATOR outperforms existing methods by a significant margin on two real-world datasets. Furthermore, ablation studies underscore the efficacy of integrating visual demographics, sentiment analysis of hashtags, and hashtag-guided attention mechanisms in enhancing the performance of post popularity prediction, thereby facilitating increased audience relevance, emotional engagement, and aesthetic appeal.

An Attention-based Neural Model for Popularity Prediction in Social Service

SENTI2POP: Sentiment-Aware Topic Popularity Prediction on Social Media

SATP: Sentiment Augmented Topic Popularity Prediction on Social Media

Multimodal Deep Learning for Social Media Popularity Prediction With Attention Mechanism

A Real-Time Method to Predict Social Media Popularity

A Dynamic Model on News Popularity Prediction in Online Social Networks

Predicting the Popularity of Topics based on User Sentiment in Microblogging Websites

EPAB: Early Pattern Aware Bayesian Model for Social Content Popularity Prediction

Sentiment and Hashtag-aware Attentive Deep Neural Network for Multimodal Post Popularity Prediction

Hierarchical Neural Network for Online News Popularity Prediction

Neural Sentiment Classification with Social Feedback Signals.

A Short-Term Prediction Model of Topic Popularity on Microblogs.

Retweet Prediction with Attention-based Deep Neural Network

Taxonomy and Evaluation for Microblog Popularity Prediction

Predicting Relative Popularity via an End-to-End Multi-modality Model.

Multi-Modal Video Feature Extraction for Popularity Prediction

Neural Network Based Popularity Prediction by Linking Online Content with Knowledge Bases.

A Feature Generalization Framework for Social Media Popularity Prediction

DeepBlue: Bi-layered LSTM for Tweet Popularity Estimation

KAPP: Knowledge-Aware Hierarchical Attention Network for Popularity Prediction

Social Information Popularity Prediction Based on Heterogeneous Diffusion Attention Network