Abstract:Temporal point process (TPP) is commonly used to model the asynchronous event sequence featuring occurrence timestamps and revealed by probabilistic models conditioned on historical impacts. While lots of previous works have focused on `goodness-of-fit' of TPP models by maximizing the likelihood, their predictive performance is unsatisfactory, which means the timestamps generated by models are far apart from true observations. Recently, deep generative models such as denoising diffusion and score matching models have achieved great progress in image generating tasks by demonstrating their capability of generating samples of high quality. However, there are no complete and unified works exploring and studying the potential of generative models in the context of event occurence modeling for TPP. In this work, we try to fill the gap by designing a unified generative framework for neural temporal point process (GNTPP) model to explore their feasibility and effectiveness, and further improve models' predictive performance. Besides, in terms of measuring the historical impacts, we revise the attentive models which summarize influence from historical events with an adaptive reweighting term considering events' type relation and time intervals. Extensive experiments have been conducted to illustrate the improved predictive capability of GNTPP with a line of generative probabilistic decoders, and performance gain from the revised attention. To the best of our knowledge, this is the first work that adapts generative models in a complete unified framework and studies their effectiveness in the context of TPP. Our codebase including all the methods given in Section.5.1.1 is open in . We hope the code framework can facilitate future research in Neural TPPs.

The Neural Process Family: Survey, Applications and Perspectives

Exploring Generative Neural Temporal Point Process

Uncertainty Estimation With Neural Processes for Meta-Continual Learning

Rényi Neural Processes

Neural Processes with Stability

Neural Stochastic Differential Equations with Neural Processes Family Members for Uncertainty Estimation in Deep Learning

NP-PROV: Neural Processes with Position-Relevant-Only Variances

NPCL: Neural Processes for Uncertainty-Aware Continual Learning

Gaussian Process Surrogate Models for Neural Networks

Diffusion-Augmented Neural Processes

Neural Process for Health Prognostics with Uncertainty Estimations.

Efficient Point-Process Modeling of Spiking Neurons for Neuroprosthesis

Bridge the Inference Gaps of Neural Processes via Expectation Maximization

Versatile Neural Processes for Learning Implicit Neural Representations

Neural Operator induced Gaussian Process framework for probabilistic solution of parametric partial differential equations

A Survey on Neural Question Generation: Methods, Applications, and Prospects

Autoregressive Conditional Neural Processes

Learning Neural Point Processes with Latent Graphs

Neural Network Gaussian Processes by Increasing Depth

Multi-fidelity Hierarchical Neural Processes