Abstract:The ability to model the information diffusion process and predict its size is crucial to understanding information propagation mechanism and is useful for many applications such as popularity prediction and fake news detection. Recent research works have attempted to address the problem of information cascade prediction using two basic paradigms: (1) sequential methods, e.g., recurrent neural networks (RNNs), and (2) graph learning techniques to retain the topological information and enable consideration of structural relationships among diffusion participants. However, existing models consider the topological and temporal features separately, falling short of simulating their entanglement in the diffusion process. As a consequence, since the evolving directed acyclic graph (DAG) of information diffusion is intrinsically coupled with both topological and temporal dependencies, there is a loss of cross-domain information. In this paper, we propose a transformer enhanced Hawkes process ( Hawkesformer ), which links the hierarchical attention mechanism to Hawkes self-exciting point process for information cascade prediction. Specifically, we extend traditional Hawkes process with a topological horizon and efficiently acquire knowledge from continuous-time domain. A two-level attention architecture is used to parameterize the intensity function of Hawkesformer. At the first-level, we disentangle the primary and non-primary paths to simulate the coupled topological and temporal information for capturing the global dependencies between the nodes in a graph. At the second-level, a local pooling attentive module is proposed to embed the cascade evolution rate for modeling short-term outbreaks. Extensive experiments on two real-world datasets demonstrate the significant performance improvements of Hawkesformer over existing state-of-the-art models.

Interpretable Transformer Hawkes Processes: Unveiling Complex Interactions in Social Networks

Tri-Transformer Hawkes Process: Three Heads are better than one

GTHP: a novel graph transformer Hawkes process for spatiotemporal event prediction

RoTHP: Rotary Position Embedding-based Transformer Hawkes Process

Mamba Hawkes Process

Transformer-enhanced Hawkes process with decoupling training for information cascade prediction

Decomposable Transformer Point Processes

Federated Transformer Hawkes Processes for Distributed Event Sequence Prediction

Temporal Attention Augmented Transformer Hawkes Process

Enhancing Time Series Forecasting: A Hierarchical Transformer with Probabilistic Decomposition Representation

Dynamic Hawkes Processes for Discovering Time-evolving Communities' States behind Diffusion Processes

TransFeat-TPP: An Interpretable Deep Covariate Temporal Point Processes

Exploring Time-Series Transformers for Spatio-Temporal Prediction of Microstructural Evolution of Polycrystalline Grain

Statistical Inference for Networks of High-Dimensional Point Processes

THP: Topological Hawkes Processes for Learning Causal Structure on Event Sequences

A Tutorial on Hawkes Processes for Events in Social Media

Transformer Embeddings of Irregularly Spaced Events and Their Participants

DHPrep: Deep Hawkes Process based Dynamic Network Representation

Interval-censored Transformer Hawkes: Detecting Information Operations using the Reaction of Social Systems

Efficient Inference for Dynamic Flexible Interactions of Neural Populations

Modelling sparsity, heterogeneity, reciprocity and community structure in temporal interaction data