Abstract:Sequences of labeled events observed at irregular intervals in continuous time are ubiquitous across various fields. Temporal Point Processes (TPPs) provide a mathematical framework for modeling these sequences, enabling inferences such as predicting the arrival time of future events and their associated label, called mark. However, due to model misspecification or lack of training data, these probabilistic models may provide a poor approximation of the true, unknown underlying process, with prediction regions extracted from them being unreliable estimates of the underlying uncertainty. This paper develops more reliable methods for uncertainty quantification in neural TPP models via the framework of conformal prediction. A primary objective is to generate a distribution-free joint prediction region for an event's arrival time and mark, with a finite-sample marginal coverage guarantee. A key challenge is to handle both a strictly positive, continuous response and a categorical response, without distributional assumptions. We first consider a simple but conservative approach that combines individual prediction regions for the event's arrival time and mark. Then, we introduce a more effective method based on bivariate highest density regions derived from the joint predictive density of arrival times and marks. By leveraging the dependencies between these two variables, this method excludes unlikely combinations of the two, resulting in sharper prediction regions while still attaining the pre-specified coverage level. We also explore the generation of individual univariate prediction regions for events' arrival times and marks through conformal regression and classification techniques. Moreover, we evaluate the stronger notion of conditional coverage. Finally, through extensive experimentation on both simulated and real-world datasets, we assess the validity and efficiency of these methods.

Probabilistic Modeling for Sequences of Sets in Continuous-Time

Modeling Continuous Time Sequences with Intermittent Observations using Marked Temporal Point Processes

Online Neural Sequence Detection with Hierarchical Dirichlet Point Process

User-Dependent Neural Sequence Models for Continuous-Time Event Data

An Empirical Study: Extensive Deep Temporal Point Process

Learning Time Series Associated Event Sequences with Recurrent Point Process Networks

Probabilistic Model Checking for Continuous Time Markov Chains via Sequential Bayesian Inference

Learning Temporal Point Processes for Efficient Retrieval of Continuous Time Event Sequences

Modeling The Intensity Function Of Point Process Via Recurrent Neural Networks

On the Efficient Marginalization of Probabilistic Sequence Models

Using Markov chain Monte Carlo and dynamic programming for event sequence data

Distribution-Free Conformal Joint Prediction Regions for Neural Marked Temporal Point Processes

Learning Conditional Generative Models for Temporal Point Processes

Infinite Hidden Semi-Markov Modulated Interaction Point Process

Predictive Querying for Autoregressive Neural Sequence Models

Continuous-Time User Preference Modelling for Temporal Sets Prediction

An Adaptive Data-Driven Imputation Model for Incomplete Event Series.

Point processes with event time uncertainty

Neuronal Sequence Models for Bayesian Online Inference

Neural Markov Jump Processes