Abstract:The ability to model the information diffusion process and predict its size is crucial to understanding information propagation mechanism and is useful for many applications such as popularity prediction and fake news detection. Recent research works have attempted to address the problem of information cascade prediction using two basic paradigms: (1) sequential methods, e.g., recurrent neural networks (RNNs), and (2) graph learning techniques to retain the topological information and enable consideration of structural relationships among diffusion participants. However, existing models consider the topological and temporal features separately, falling short of simulating their entanglement in the diffusion process. As a consequence, since the evolving directed acyclic graph (DAG) of information diffusion is intrinsically coupled with both topological and temporal dependencies, there is a loss of cross-domain information. In this paper, we propose a transformer enhanced Hawkes process ( Hawkesformer ), which links the hierarchical attention mechanism to Hawkes self-exciting point process for information cascade prediction. Specifically, we extend traditional Hawkes process with a topological horizon and efficiently acquire knowledge from continuous-time domain. A two-level attention architecture is used to parameterize the intensity function of Hawkesformer. At the first-level, we disentangle the primary and non-primary paths to simulate the coupled topological and temporal information for capturing the global dependencies between the nodes in a graph. At the second-level, a local pooling attentive module is proposed to embed the cascade evolution rate for modeling short-term outbreaks. Extensive experiments on two real-world datasets demonstrate the significant performance improvements of Hawkesformer over existing state-of-the-art models.

Decoupling Representation and Regressor for Long-Tailed Information Cascade Prediction

Mining Subcascade Features for Cascade Outbreak Prediction in Big Networks.

Anytime User Engagement Prediction in Information Cascades for Arbitrary Observation Periods

Information Diffusion Prediction via Recurrent Cascades Convolution

Wordreg: Mitigating the Gap Between Training and Inference with Worst-Case Drop Regularization

Information Cascades Modeling Via Deep Multi-Task Learning

CasCIFF: A Cross-Domain Information Fusion Framework Tailored for Cascade Prediction in Social Networks

Variational Information Diffusion for Probabilistic Cascades Prediction

Modelling the Latent Semantics of Diffusion Sources in Information Cascade Prediction

Hierarchical Attention Neural Network for Information Cascade Prediction

Continual Information Cascade Learning

Hierarchical Information Enhancement Network for Cascade Prediction in Social Networks

Learning user-specific latent influence and susceptibility from information cascades

Structural-topic aware deep neural networks for information cascade prediction

Explicit Time Embedding Based Cascade Attention Network for Information Popularity Prediction

Decoupling Representation and Classifier for Long-Tailed Recognition

Decoupled Training for Long-Tailed Classification With Stochastic Representations

Transformer-enhanced Hawkes process with decoupling training for information cascade prediction

Full-scale Cascade Dynamics Prediction with a Local-First Approach.

A Survey of Deep Learning-Based Information Cascade Prediction

CasFlow: Exploring Hierarchical Structures and Propagation Uncertainty for Cascade Prediction