Multiplicative component models for replicated point processes

Daniel Gervini

DOI: https://doi.org/10.48550/arXiv.1705.09693

2017-05-27

Abstract:We propose a multiplicative semiparametric model for the intensity function of replicated point processes. Two examples of applications are given: a temporal one, about the dynamics of Internet auctions, and a spatial one, about the spatial distribution of street robberies in Chicago.

Methodology

What problem does this paper attempt to address?

Independent component models for replicated point processes

Daniel Gervini

DOI: https://doi.org/10.48550/arXiv.1506.00137

2015-05-31

Abstract:We propose a semiparametric independent-component model for the intensity functions of a point process. When independent replications of the process are available, we show that the estimators are consistent and asymptotically normal. We study the finite-sample behavior of the estimators by simulation, and as an example of application we analyze the spatial distribution of street robberies in the city of Chicago.

Methodology
Semiparametric Transformation Models for Point Processes

DY Lin,LJ Wei,Z Ying

DOI: https://doi.org/10.1198/016214501753168299

IF: 4.369

2001-01-01

Journal of the American Statistical Association

Abstract:In this article we propose a family of semiparametric transformation models for point. processes with positive jumps of arbitrary sizes. These models offer great flexibilities in formulating the effects of covariates on the mean function of the point process while leaving the stochastic structure completely unspecified. We develop a class of estimating equations for the baseline mean function and the vector-valued regression parameter based on censored point processes and covariate data. These equations can be solved easily by the standard Newton-Raphson algorithm. The resultant estimator of the regression parameter is consistent and asymptotically normal with a covariance matrix that can be estimated consistently Furthermore, the estimator of the baseline mean function is uniformly consistent and, upon proper normalization, converges weakly to a zero-mean Gaussian process with an easily estimated covariance function. We demonstrate through extensive simulation studies that the proposed inference procedures are appropriate for practical use. The data on recurrent pulmonary exacerbations from a cystic fibrosis clinical trial are provided for illustration.
Point process modeling for directed interaction networks

Patrick O. Perry,Patrick J. Wolfe

DOI: https://doi.org/10.1111/rssb.12013

2012-11-21

Abstract:Network data often take the form of repeated interactions between senders and receivers tabulated over time. A primary question to ask of such data is which traits and behaviors are predictive of interaction. To answer this question, a model is introduced for treating directed interactions as a multivariate point process: a Cox multiplicative intensity model using covariates that depend on the history of the process. Consistency and asymptotic normality are proved for the resulting partial-likelihood-based estimators under suitable regularity conditions, and an efficient fitting procedure is described. Multicast interactions--those involving a single sender but multiple receivers--are treated explicitly. The resulting inferential framework is then employed to model message sending behavior in a corporate e-mail network. The analysis gives a precise quantification of which static shared traits and dynamic network effects are predictive of message recipient selection.

Methodology,Social and Information Networks,Statistics Theory
Additive mixed models with approximate Dirichlet process mixtures: the EM approach

Felix Heinzl,Gerhard Tutz

DOI: https://doi.org/10.1007/s11222-014-9475-z

IF: 2.3241

2014-05-06

Statistics and Computing

Abstract:We consider additive mixed models for longitudinal data with a nonlinear time trend. As random effects distribution an approximate Dirichlet process mixture is proposed that is based on the truncated version of the stick breaking presentation of the Dirichlet process and provides a Gaussian mixture with a data driven choice of the number of mixture components. The main advantage of the specification is its ability to identify clusters of subjects with a similar random effects structure. For the estimation of the trend curve the mixed model representation of penalized splines is used. An Expectation-Maximization algorithm is given that solves the estimation problem and that exhibits advantages over Markov chain Monte Carlo approaches, which are typically used when modeling with Dirichlet processes. The method is evaluated in a simulation study and applied to theophylline data and to body mass index profiles of children.

statistics & probability,computer science, theory & methods
Modelling Point Referenced Spatial Count Data: A Poisson Process Approach

Diego Morales-Navarrete,Moreno Bevilacqua,Christian Caamaño-Carrillo,Luis M. Castro

DOI: https://doi.org/10.48550/arXiv.2105.03734

2022-10-13

Abstract:Random fields are useful mathematical tools for representing natural phenomena with complex dependence structures in space and/or time. In particular, the Gaussian random field is commonly used due to its attractive properties and mathematical tractability. However, this assumption seems to be restrictive when dealing with counting data. To deal with this situation, we propose a random field with a Poisson marginal distribution by considering a sequence of independent copies of a random field with an exponential marginal distribution as 'inter-arrival times' in the counting renewal processes framework. Our proposal can be viewed as a spatial generalization of the Poisson process. Unlike the classical hierarchical Poisson Log-Gaussian model, our proposal generates a (non)-stationary random field that is mean square continuous and with Poisson marginal distributions. For the proposed Poisson spatial random field, analytic expressions for the covariance function and the bivariate distribution are provided. In an extensive simulation study, we investigate the weighted pairwise likelihood as a method for estimating the Poisson random field parameters. Finally, the effectiveness of our methodology is illustrated by an analysis of reindeer pellet-group survey data, where a zero-inflated version of the proposed model is compared with zero-inflated Poisson Log-Gaussian and Poisson Gaussian copula models. Supplementary materials for this article, include technical proofs and R code for reproducing the work, are available as an online supplement.

Methodology
Efficient, Cross-Fitting Estimation of Semiparametric Spatial Point Processes

Xindi Lin,Hyunseung Kang

DOI: https://doi.org/10.48550/arXiv.2410.04359

2024-10-06

Abstract:We study a broad class of models called semiparametric spatial point processes where the first-order intensity function contains both a parametric component and a nonparametric component. We propose a novel, spatial cross-fitting estimator of the parametric component based on random thinning, a common simulation technique in point processes. The proposed estimator is shown to be consistent and in many settings, asymptotically Normal. Also, we generalize the notion of semiparametric efficiency lower bound in i.i.d. settings to spatial point processes and show that the proposed estimator achieves the efficiency lower bound if the process is Poisson. Next, we present a new spatial kernel regression estimator that can estimate the nonparametric component of the intensity function at the desired rates for inference. Despite the dependence induced by the point process, we show that our estimator can be computed using existing software for generalized partial linear models in i.i.d. settings. We conclude with a small simulation study and a re-analysis of the spatial distribution of rainforest trees.

Methodology
Point process modeling through a mixture of homogeneous and self‐exciting processes

Álvaro Briz‐Redón,Jorge Mateu

DOI: https://doi.org/10.1111/stan.12334

2024-01-17

Statistica Neerlandica

Abstract:Self‐exciting point processes allow modeling the temporal location of an event of interest, considering the history provided by previously observed events. This family of point processes is commonly used in several areas such as criminology, economics, or seismology, among others. The standard formulation of the self‐exciting process implies assuming that the underlying stochastic process is dependent on its previous history over the entire period under analysis. In this paper, we consider the possibility of modeling a point pattern through a point process whose structure is not necessarily of self‐exciting type at every instant or temporal interval. Specifically, we propose a mixture point process model that allows the point process to be either self‐exciting or homogeneous Poisson, depending on the instant within the study period. The performance of this model is evaluated both through a simulation study and a case study. The results indicate that the model is able to detect the presence of instants in time, referred to as change points, where the nature of the process varies.

statistics & probability
A Shared Component Point Process Model for Urban Policing

Claire Kelling,Murali Haran

DOI: https://doi.org/10.48550/arXiv.2303.00206

2023-03-01

Methodology

Abstract:Newly available point-level datasets allow us to relate police use of force to other events describing police behavior. Current methods for relating two point processes typically rely on the spatial aggregation of one of the two point processes. We investigate new methods that build upon shared component models and case-control methods to retain the point-level nature of both point processes while characterizing the relationship between them. We find that the shared component approach is particularly useful in flexibly relating two point processes, and we illustrate this flexibility in simulated examples and an application to Chicago policing data.
Replica-mean-field limit of continuous-time fragmentation-interaction-aggregation processes

Michel Davydov

2024-03-21

Abstract:Many phenomena can be modeled as network dynamics with punctuate interactions. However, most relevant dynamics do not allow for computational tractability. To circumvent this difficulty, the Poisson Hypothesis regime replaces interaction times between nodes by independent Poisson processes, allowing for tractability in several cases, such as intensity-based models from computational neuroscience. This hypothesis is usually only conjectured, or numerically validated. In this work, we introduce a class of processes in continuous time called continuous fragmentation-interaction-aggregation processes, by analogy with previously introduced processes in discrete time. The state of each node, described by the stochastic intensity of an associated point process, aggregates arrivals from its neighbors and is fragmented upon departure. We consider the replica-mean-field version of such a process, which is a physical system consisting of randomly interacting copies of the network of interest. Generalizing results proved in discrete time and in the particular case of excitatory intensity-based neural dynamics, we prove that the Poisson Hypothesis holds at the limit of an infinite number of replicas.

Probability,Dynamical Systems
Estimation of nonstationary nonparametric regression model with multiplicative structure

Likai Chen,Ekaterina Smetanina,Wei Biao Wu

DOI: https://doi.org/10.1093/ectj/utab018

2021-06-12

Abstract:Summary This paper presents a multiplicative nonstationary nonparametric regression model which allows for a broad class of nonstationary processes. We propose a three-step estimation procedure to uncover the conditional mean function and establish uniform convergence rates and asymptotic normality of our estimators. The new model can also be seen as a dimension-reduction technique for a general two-dimensional time-varying nonparametric regression model, which is especially useful in small samples and for estimating explicitly multiplicative structural models. We consider two applications: estimating a pricing equation for the US aggregate economy to model consumption growth and estimating the shape of the monthly risk premium for S&P 500 Index data.

economics,social sciences, mathematical methods,mathematics, interdisciplinary applications,statistics & probability
Unlocking Point Processes through Point Set Diffusion

David Lüdke,Enric Rabasseda Raventós,Marcel Kollovieh,Stephan Günnemann

2024-10-30

Abstract:Point processes model the distribution of random point sets in mathematical spaces, such as spatial and temporal domains, with applications in fields like seismology, neuroscience, and economics. Existing statistical and machine learning models for point processes are predominantly constrained by their reliance on the characteristic intensity function, introducing an inherent trade-off between efficiency and flexibility. In this paper, we introduce Point Set Diffusion, a diffusion-based latent variable model that can represent arbitrary point processes on general metric spaces without relying on the intensity function. By directly learning to stochastically interpolate between noise and data point sets, our approach enables efficient, parallel sampling and flexible generation for complex conditional tasks defined on the metric space. Experiments on synthetic and real-world datasets demonstrate that Point Set Diffusion achieves state-of-the-art performance in unconditional and conditional generation of spatial and spatiotemporal point processes while providing up to orders of magnitude faster sampling than autoregressive baselines.

Machine Learning
Bayesian inference for Matérn repulsive processes

Vinayak Rao,Ryan P. Adams,David B. Dunson

DOI: https://doi.org/10.48550/arXiv.1308.1136

2015-04-04

Abstract:In many applications involving point pattern data, the Poisson process assumption is unrealistic, with the data exhibiting a more regular spread. Such a repulsion between events is exhibited by trees for example, because of competition for light and nutrients. Other examples include the locations of biological cells and cities, and the times of neuronal spikes. Given the many applications of repulsive point processes, there is a surprisingly limited literature developing flexible, realistic and interpretable models, as well as efficient inferential methods. We address this gap by developing a modelling framework around the Matérn type-III repulsive process. We consider a number of extensions of the original Matérn type-III process for both the homogeneous and inhomogeneous cases. We also derive the probability density of this generalized Matérn process. This allows us to characterize the posterior distribution of the various latent variables, and leads to a novel and efficient Markov chain Monte Carlo algorithm. We apply our ideas to datasets involving the spatial locations of trees, nerve fiber cells and Greyhound bus stations.

Methodology
Estimation for the Prediction of Point Processes with Many Covariates

Alessio Sancetta

DOI: https://doi.org/10.48550/arXiv.1702.05315

2017-02-17

Abstract:Estimation of the intensity of a point process is considered within a nonparametric framework. The intensity measure is unknown and depends on covariates, possibly many more than the observed number of jumps. Only a single trajectory of the counting process is observed. Interest lies in estimating the intensity conditional on the covariates. The impact of the covariates is modelled by an additive model where each component can be written as a linear combination of possibly unknown functions. The focus is on prediction as opposed to variable screening. Conditions are imposed on the coefficients of this linear combination in order to control the estimation error. The rates of convergence are optimal when the number of active covariates is large. As an application, the intensity of the buy and sell trades of the New Zealand dollar futures is estimated and a test for forecast evaluation is presented. A simulation is included to provide some finite sample intuition on the model and asymptotic properties.

Statistics Theory,Trading and Market Microstructure
Sparse Approximate Inference for Spatio-Temporal Point Process Models

Botond Cseke,Andrew Zammit Mangion,Tom Heskes,Guido Sanguinetti

DOI: https://doi.org/10.48550/arXiv.1305.4152

2015-07-06

Abstract:Spatio-temporal point process models play a central role in the analysis of spatially distributed systems in several disciplines. Yet, scalable inference remains computa- tionally challenging both due to the high resolution modelling generally required and the analytically intractable likelihood function. Here, we exploit the sparsity structure typical of (spatially) discretised log-Gaussian Cox process models by using approximate message-passing algorithms. The proposed algorithms scale well with the state dimension and the length of the temporal horizon with moderate loss in distributional accuracy. They hence provide a flexible and faster alternative to both non-linear filtering-smoothing type algorithms and to approaches that implement the Laplace method or expectation propagation on (block) sparse latent Gaussian models. We infer the parameters of the latent Gaussian model using a structured variational Bayes approach. We demonstrate the proposed framework on simulation studies with both Gaussian and point-process observations and use it to reconstruct the conflict intensity and dynamics in Afghanistan from the WikiLeaks Afghan War Diary.

Machine Learning
A Bayesian semiparametric vector Multiplicative Error Model

Nicola Donelli,Stefano Peluso,Antonietta Mira

DOI: https://doi.org/10.1016/j.csda.2021.107242

2021-09-01

Abstract:<p>Interactions among multiple time series of positive random variables are crucial in diverse financial applications, from spillover effects to volatility interdependence. A popular model in this setting is the vector Multiplicative Error Model (vMEM) which poses a linear iterative structure on the dynamics of the conditional mean, perturbed by a multiplicative innovation term. A main limitation of vMEM is however its restrictive assumption on the distribution of the random innovation term. A Bayesian semiparametric approach that models the innovation vector as an infinite location-scale mixture of multidimensional kernels with support on the positive orthant is used to address this major shortcoming of vMEM. Computational complications arising from the constraints to the positive orthant are avoided through the formulation of a slice sampler on the parameter-extended unconstrained version of the model. The method is applied to simulated and real data and a flexible specification is obtained that outperforms the classical ones in terms of fitting and predictive power.</p>

statistics & probability,computer science, interdisciplinary applications
Replica-mean-field limits of fragmentation-interaction-aggregation processes

François Baccelli,Michel Davydov,Thibaud Taillefumier

DOI: https://doi.org/10.1017/jpr.2021.31

IF: 1.1161

2022-01-17

Journal of Applied Probability

Abstract:Abstract Network dynamics with point-process-based interactions are of paramount modeling interest. Unfortunately, most relevant dynamics involve complex graphs of interactions for which an exact computational treatment is impossible. To circumvent this difficulty, the replica-mean-field approach focuses on randomly interacting replicas of the networks of interest. In the limit of an infinite number of replicas, these networks become analytically tractable under the so-called ‘Poisson hypothesis’. However, in most applications this hypothesis is only conjectured. In this paper we establish the Poisson hypothesis for a general class of discrete-time, point-process-based dynamics that we propose to call fragmentation-interaction-aggregation processes, and which are introduced here. These processes feature a network of nodes, each endowed with a state governing their random activation. Each activation triggers the fragmentation of the activated node state and the transmission of interaction signals to downstream nodes. In turn, the signals received by nodes are aggregated to their state. Our main contribution is a proof of the Poisson hypothesis for the replica-mean-field version of any network in this class. The proof is obtained by establishing the propagation of asymptotic independence for state variables in the limit of an infinite number of replicas. Discrete-time Galves–Löcherbach neural networks are used as a basic instance and illustration of our analysis.

statistics & probability
Semiparametric Multinomial Logistic Regression for Multivariate Point Pattern Data

Kristian Bjørn Hessellund,Ganggang Xu,Yongtao Guan,Rasmus Waagepetersen

DOI: https://doi.org/10.1080/01621459.2020.1863812

IF: 4.369

2021-03-16

Journal of the American Statistical Association

Abstract:<span>We propose a new method for analysis of multivariate point pattern data observed in a heterogeneous environment and with complex intensity functions. We suggest semiparametric models for the intensity functions that depend on an unspecified factor common to all types of points. This is for example well suited for analyzing spatial covariate effects on events such as street crime activities that occur in a complex urban environment. A multinomial conditional composite likelihood function is introduced for estimation of intensity function regression parameters and the asymptotic joint distribution of the resulting estimators is derived under mild conditions. Crucially, the asymptotic covariance matrix depends on ratios of cross pair correlation functions of the multivariate point process. To make valid statistical inference without restrictive assumptions, we construct consistent nonparametric estimators for these ratios. Finally, we construct standardized residual plots, predictive probability plots, and semiparametric intensity plots to validate and to visualize the findings of the model. The effectiveness of the proposed methodology is demonstrated through extensive simulation studies and an application to analyzing the effects of socio-economic and demographical variables on occurrences of street crimes in Washington DC. <a class="ext-link" href="https://doi.org/10.1080/01621459.2020.1863812">Supplementary materials</a> for this article are available online.</span>

statistics & probability
PCA for Point Processes

Franck Picard,Vincent Rivoirard,Angelina Roche,Victor Panaretos

DOI: https://doi.org/10.48550/arxiv.2404.19661

2024-04-30

Methodology

Abstract:We introduce a novel statistical framework for the analysis of replicated point processes that allows for the study of point pattern variability at a population level. By treating point process realizations as random measures, we adopt a functional analysis perspective and propose a form of functional Principal Component Analysis (fPCA) for point processes. The originality of our method is to base our analysis on the cumulative mass functions of the random measures which gives us a direct and interpretable analysis. Key theoretical contributions include establishing a Karhunen-Lo\`{e}ve expansion for the random measures and a Mercer Theorem for covariance measures. We establish convergence in a strong sense, and introduce the concept of principal measures, which can be seen as latent processes governing the dynamics of the observed point patterns. We propose an easy-to-implement estimation strategy of eigenelements for which parametric rates are achieved. We fully characterize the solutions of our approach to Poisson and Hawkes processes and validate our methodology via simulations and diverse applications in seismology, single-cell biology and neurosiences, demonstrating its versatility and effectiveness. Our method is implemented in the pppca R-package.
Semi-Parametric Inference for Doubly Stochastic Spatial Point Processes: An Approximate Penalized Poisson Likelihood Approach

Si Cheng,Jon Wakefield,Ali Shojaie

DOI: https://doi.org/10.48550/arXiv.2306.06756

2024-06-27

Abstract:Doubly-stochastic point processes model the occurrence of events over a spatial domain as an inhomogeneous Poisson process conditioned on the realization of a random intensity function. They are flexible tools for capturing spatial heterogeneity and dependence. However, existing implementations of doubly-stochastic spatial models are computationally demanding, often have limited theoretical guarantee, and/or rely on restrictive assumptions. We propose a penalized regression method for estimating covariate effects in doubly-stochastic point processes that is computationally efficient and does not require a parametric form or stationarity of the underlying intensity. Our approach is based on an approximate (discrete and deterministic) formulation of the true (continuous and stochastic) intensity function. We show that consistency and asymptotic normality of the covariate effect estimates can be achieved despite the model misspecification, and develop a covariance estimator that leads to a valid, albeit conservative, statistical inference procedure. A simulation study shows the validity of our approach under less restrictive assumptions on the data generating mechanism, and an application to Seattle crime data demonstrates better prediction accuracy compared with existing alternatives.

Methodology,Computation,Machine Learning
A Multiscale Stochastic Criminal Behavior Model and the Convergence to a Piecewise-Deterministic-markov-process Limit

Yiru Cai,Chuntian Wang,Yuan Zhang

DOI: https://doi.org/10.1142/s0218202522500142

2022-01-01

Mathematical Models and Methods in Applied Sciences

Abstract:Ever since the pioneering human–environment interaction model of criminal behavior [M. B. Short, M. R. DOrsogna, V. B. Pasour, G. E. Tita, P. J. Brantingham, A. L. Bertozzi and L. B. Chayes, A statistical model of criminal behavior, Math. Models Methods Appl. Sci. 18 (2008) 1249–1267] was published, many mathematical agent-based residential burglary models have been proposed. In order to reach an improved balance among model accuracy, analysis simplicity and real-world data fitting tractability, we introduce in this paper a multi-scale hybrid interacting-particle-system model of criminal behavior in a discrete setting. We assume that agents’ actions are governed by independent Poisson clocks, while the environment variable evolves on a separate finer discrete spatial-temporal scale. Furthermore, as we refine the second scale to its scaling limit, the hybrid system converges to a piecewise deterministic Markov process (PDMP). Through a martingale approach and infinitesimal generator analysis, we provide a formal derivation for the convergence. Computer simulations of coupled hybrid and PDMP systems both exhibit spatio-temporal aggregates of crime and show excellent agreement between the two, which supports our theoretical derivation of the scaling limit. The methodology and results we develop here indicate a way to establish connections for the proposed crime models.

Multiplicative component models for replicated point processes

Independent component models for replicated point processes

Semiparametric Transformation Models for Point Processes

Point process modeling for directed interaction networks

Additive mixed models with approximate Dirichlet process mixtures: the EM approach

Modelling Point Referenced Spatial Count Data: A Poisson Process Approach

Efficient, Cross-Fitting Estimation of Semiparametric Spatial Point Processes

Point process modeling through a mixture of homogeneous and self‐exciting processes

A Shared Component Point Process Model for Urban Policing

Replica-mean-field limit of continuous-time fragmentation-interaction-aggregation processes

Estimation of nonstationary nonparametric regression model with multiplicative structure

Unlocking Point Processes through Point Set Diffusion

Bayesian inference for Matérn repulsive processes

Estimation for the Prediction of Point Processes with Many Covariates

Sparse Approximate Inference for Spatio-Temporal Point Process Models

A Bayesian semiparametric vector Multiplicative Error Model

Replica-mean-field limits of fragmentation-interaction-aggregation processes

Semiparametric Multinomial Logistic Regression for Multivariate Point Pattern Data

PCA for Point Processes

Semi-Parametric Inference for Doubly Stochastic Spatial Point Processes: An Approximate Penalized Poisson Likelihood Approach

A Multiscale Stochastic Criminal Behavior Model and the Convergence to a Piecewise-Deterministic-markov-process Limit