Clustering of large deviations in moving average processes: the short memory regime

Arijit Chakrabarty,Gennady Samorodnitsky

2023-12-08

Abstract:We describe the cluster of large deviations events that arise when one such large deviations event occurs. We work in the framework of an infinite moving average process with a noise that has finite exponential moments.

Probability

What problem does this paper attempt to address?

The effect of memory on functional large deviations of infinite moving average processes

Souvik Ghosh,Gennady Samorodnitsky

DOI: https://doi.org/10.48550/arXiv.0708.0865

2008-02-27

Abstract:The large deviations of an infinite moving average process with exponentially light tails are very similar to those of an i.i.d. sequence as long as the coefficients decay fast enough. If they do not, the large deviations change dramatically. We study this phenomenon in the context of functional large, moderate and huge deviation principles.

Probability
Functional limit theorem for moving average processes generated by dependent random variables

ZY Lin,DG Li

2006-01-01

Progress in Natural Science

Abstract:Let {X-t, t >= 1} be a moving average process defined by X-t = Sigma(infinity)(j=0)b(j)xi(t-j), where {b(j), j >= 0} is a sequence of real numbers and {xi(t), - infinity < t < infinity} is a doubly infinite sequence of strictly stationary phi-mixing random variables. Under conditions on {b(j), j >= 0} which entail that {X-t, t >= 1} is either a long memory process or a linear process, we study asymptotics of S-n(s) = Sigma X-[ns](t=1)t (properly normalized). When {X-t, t >= 1} is a long memory process, we establish a functional limit theorem. When {X-t, t >= 1} is a linear process, we not only obtain the multi-dimensional weak convergence for {X-t, t >= 1}, but also weaken the moment condition on {xi(t), -infinity < t <infinity} and the restriction on {b(j), j >= 0}. Finally, we give some applications of our results.
Strong Approximation for Moving Average Processes under Dependence Assumptions

Lin Zhengyan,Li Degui

DOI: https://doi.org/10.1016/s0252-9602(08)60023-5

2008-01-01

Abstract:Let {X-t,t >= 1} be a moving average process defined by X-t = Sigma(infinity)(k=0)a(k)xi(t-k), where {a(k), k >= 0} is a sequence of real numbers and {xi(t), -infinity < t < infinity} is a doubly infinite sequence of strictly stationary dependent random variables. Under the conditions of {a(k), k >= 0} which entail that {X-t, t >= 1} is either a long memory process or a linear process, the strong approximation of {X-t, t >= 1} to a Gaussian process is studied. Finally, the results are applied to obtain the strong approximation of a long memory process to a fractional Brownian motion and the laws of the iterated logarithm for moving average processes.
Precise Asymptotics in the Law of the Iterated Logarithm of Moving-Average Processes

Yun Xia Li,Li Xin Zhang

DOI: https://doi.org/10.1007/s10114-005-0542-4

2006-01-01

Abstract:In this paper, we discuss the moving-average process X_k = ∑_i = - ∞^∞α _i + kε _i , where α i ;-∞ < i < ∞ is a doubly infinite sequence of identically distributed φ-mixing or negatively associated random variables with mean zeros and finite variances, α i ;-∞ < i < ∞ is an absolutely summable sequence of real numbers. Set S_n = ∑_k = 1^n X_k ,n ⩾ 1 . Suppose that σ ^2 = Eε ^2_1 + 2∑_k = 2^∞Eε _1ε _k > 0 . We prove that for any δ⩾ 0, if E[ ε ^2_1( log log| ε _1|)^δ - 1] < ∞ , lim_∈↘ o∈ ^2δ + 2∑_n = 1^∞( log log n)^δ/n log nP{| S_n|⩾ετ√(2n log log n)} = 1/( δ + 1)√(π)Γ( δ + 3/2), , and if E[ ε ^2_1( log| ε _1|)^δ - 1] < ∞ , lim_∈↘ o∈ ^2δ + 2∑_n = 1^∞( log n)δ/nP{| S_n|⩾ετ√(n log n)} = μ ^( 2δ + 2)/δ + 1τ ^2δ + 2 , where τ = σ·∑_i = - ∞^∞α _i ,Γ( ·) is a Gamma function and μ (2δ+2) stands for the (2δ + 2)-th absolute moment of the standard normal distribution.
Large deviations and applications for Markovian Hawkes processes with a large initial intensity

Xuefeng Gao,Lingjiong Zhu

DOI: https://doi.org/10.48550/arXiv.1603.07222

2017-04-13

Abstract:Hawkes process is a class of simple point processes that is self-exciting and has clustering effect. The intensity of this point process depends on its entire past history. It has wide applications in finance, insurance, neuroscience, social networks, criminology, seismology, and many other fields. In this paper, we study linear Hawkes process with an exponential kernel in the asymptotic regime where the initial intensity of the Hawkes process is large. We establish large deviations for Hawkes processes in this regime as well as the regime when both the initial intensity and the time are large. We illustrate the strength of our results by discussing the applications to insurance and queueing systems.

Probability
Large Deviations for High Minima of Gaussian Processes with Nonnegatively Correlated Increments

Zachary Selk

2024-04-05

Abstract:In this article we prove large deviations principles for high minima of Gaussian processes with nonnegatively correlated increments on arbitrary intervals. Furthermore, we prove large deviations principles for the increments of such processes on intervals $[a,b]$ where $b-a$ is either less than the increment or twice the increment, assuming stationarity of the increments. As a chief example, we consider fractional Brownian motion and fractional Gaussian noise for $H\geq 1/2$.

Probability
A framework for the direct evaluation of large deviations in non-Markovian processes

Massimo Cavallaro,Rosemary J. Harris

DOI: https://doi.org/10.1088/1751-8113/49/47/47LT02

2023-07-07

Abstract:We propose a general framework to simulate stochastic trajectories with arbitrarily long memory dependence and efficiently evaluate large deviation functions associated to time-extensive observables. This extends the "cloning" procedure of Giardiná et al. [Phys. Rev. Lett. 96, 120603 (2006)] to non-Markovian systems. We demonstrate the validity of this method by testing non-Markovian variants of an ion-channel model and the Totally Asymmetric Exclusion Process, recovering results obtainable by other means.

Statistical Mechanics
Large Deviations for Empirical Measures of Self-Interacting Markov Chains

Amarjit Budhiraja,Adam Waterbury,Pavlos Zoubouloglou

2023-04-11

Abstract:Let $\Delta^o$ be a finite set and, for each probability measure $m$ on $\Delta^o$, let $G(m)$ be a transition probability kernel on $\Delta^o$. Fix $x_0 \in \Delta^o$ and consider the chain $\{X_n, \; n \in \mathbb{N}_0\}$ of $\Delta^o$-valued random variables such that $X_0=x$, and given $X_0, \ldots , X_n$, the conditional distribution of $X_{n+1}$ is $G(L^{n+1})(X_n, \cdot)$, where $L^{n+1} = \frac{1}{n+1} \sum_{i=0}^{n} \delta_{X_i}$ is the empirical measure at instant $n$. Under conditions on $G$ we establish a large deviation principle for the empirical measure sequence $\{L^n, \; n \in \mathbb{N}\}$. As one application of this result we obtain large deviation asymptotics for the Aldous-Flannery-Palacios (1988) approximation scheme for quasistationary distributions of irreducible finite state Markov chains. The conditions on $G$ cover various other models of reinforced stochastic evolutions as well, including certain vertex reinforced and edge reinforced random walks and a variant of the PageRank algorithm. The particular case where $G(m)$ does not depend on $m$ corresponds to the classical results of Donsker and Varadhan (1975) on large deviations of empirical measures of Markov processes. However, unlike this classical setting, for the general self-interacting models considered here, the rate function takes a very different form; it is typically non-convex and is given through a dynamical variational formula with an infinite horizon discounted objective function.

Probability,Optimization and Control
Condensation transition in large deviations of self-similar Gaussian processes with stochastic resetting

Naftali R. Smith,Satya N. Majumdar

DOI: https://doi.org/10.1088/1742-5468/ac6f04

2022-02-08

Abstract:We study the fluctuations of the area $A(t)= \int_0^t x(\tau)\, d\tau$ under a self-similar Gaussian process (SGP) $x(\tau)$ with Hurst exponent $H>0$ (e.g., standard or fractional Brownian motion, or the random acceleration process) that stochastically resets to the origin at rate $r$. Typical fluctuations of $A(t)$ scale as $\sim \sqrt{t}$ for large $t$ and on this scale the distribution is Gaussian, as one would expect from the central limit theorem. Here our main focus is on atypically large fluctuations of $A(t)$. In the long-time limit $t\to\infty$, we find that the full distribution of the area takes the form $P_{r}\left(A|t\right)\sim\exp\left[-t^{\alpha}\Phi\left(A/t^{\beta}\right)\right]$ with anomalous exponents $\alpha=1/(2H+2)$ and $\beta = (2H+3)/(4H+4)$ in the regime of moderately large fluctuations, and a different anomalous scaling form $P_{r}\left(A|t\right)\sim\exp\left[-t\Psi\left(A/t^{\left(2H+3\right)/2}\right)\right]$ in the regime of very large fluctuations. The associated rate functions $\Phi(y)$ and $\Psi(w)$ depend on $H$ and are found exactly. Remarkably, $\Phi(y)$ has a singularity that we interpret as a first-order dynamical condensation transition, while $\Psi(w)$ exhibits a second-order dynamical phase transition above which the number of resetting events ceases to be extensive. The parabolic behavior of $\Phi(y)$ around the origin $y=0$ correctly describes the typical, Gaussian fluctuations of $A(t)$. Despite these anomalous scalings, we find that all of the cumulants of the distribution $P_{r}\left(A|t\right)$ grow linearly in time, $\langle A^n\rangle_c\approx c_n \, t$, in the long-time limit. For the case of reset Brownian motion (corresponding to $H=1/2$), we develop a recursive scheme to calculate the coefficients $c_n$ exactly and use it to calculate the first 6 nonvanishing cumulants.

Statistical Mechanics,Mathematical Physics
Large Deviations for Empirical Processes of Interacting Particle Systems

JW Chen

DOI: https://doi.org/10.1088/0305-4470/34/8/307

2001-01-01

Abstract:In this paper we study process-level large deviations for spin-flip particle systems and more general Markov processes. We prove that a modification of a well known Donsker-Varadhan entropy function can be used to govern the large deviation lower bounds for any such process starting from a class of initial distributions related to an extremal invariant measure of the process. In some specific cases, we obtain the full large deviation principle.
Large deviations principle for a stochastic process with random reinforced relocations

Erion-Stelios Boci,Cécile Mailler

2023-07-11

Abstract:Stochastic processes with random reinforced relocations have been introduced in the physics literature to model animal foraging behaviour. Such a process evolves as a Markov process, except at random relocation times, when it chooses a time at random in its whole past according to some ``memory kernel'', and jumps to its value at that random time. We prove a quenched large deviations principle for the value of the process at large times. The difficulty in proving this result comes from the fact that the process is not Markov because of the relocations. Furthermore, the random inter-relocation times act as a random environment.

Probability
Large Deviations for Small Noise Diffusions Over Long Time

Amarjit Budhiraja,Pavlos Zoubouloglou

2023-09-13

Abstract:We study two problems. First, we consider the large deviation behavior of empirical measures of certain diffusion processes as, simultaneously, the time horizon becomes large and noise becomes vanishingly small. The law of large numbers (LLN) of the empirical measure in this asymptotic regime is given by the unique equilibrium of the noiseless dynamics. Due to degeneracy of the noise in the limit, the methods of Donsker and Varadhan (1976) are not directly applicable and new ideas are needed. Second, we study a system of slow-fast diffusions where both the slow and the fast components have vanishing noise on their natural time scales. This time the LLN is governed by a degenerate averaging principle in which local equilibria of the noiseless system obtained from the fast dynamics describe the asymptotic evolution of the slow component. We establish a large deviation principle that describes probabilities of divergence from this behavior. On the one hand our methods require stronger assumptions than the nondegenerate settings, while on the other hand the rate functions take simple and explicit forms that have striking differences from their nondegenerate counterparts.

Probability
A remarkable example on clustering of extremes for regularly-varying stochastic processes

Shuyang Bai,Rafał Kulik,Yizao Wang

2024-10-10

Abstract:The stable-regenerative multiple-stable model has been shown recently to have distinct candidate extremal index and extremal index. To understand further this rare phenomenon, two more results are established here for the double-stable model. The first is the convergence of point processes for the clusters of extremes, enhancing the previous result on the weak convergence of random sup-measures. Most interestingly, the second result reveals a new phase transition at the mesoscopic level when computing the asymptotic exceedance probability over a block, $\mathbb P(\max_{k=1,\dots,d_n} X_k>b_n)$, as $n\to\infty$. Here, the mesoscopic level is referred to the fact that the block size $d_n$ is allowed to grow at the rate $n^\rho$ with $\rho\in[0,1]$, while the threshold $b_n$ is such that $\mathbb P(X_1>b_n)\sim 1/n$. The recently discovered discrepancy between the candidate extremal index and the extremal index is shown to be just a reflection of this phase transition that is prohibited by the anticlustering condition.

Probability
Extremal Dependence of Moving Average Processes Driven by Exponential-Tailed Lévy Noise

Zhongwei Zhang,David Bolin,Sebastian Engelke,Raphaël Huser

DOI: https://doi.org/10.48550/arXiv.2307.15796

2023-07-29

Abstract:Moving average processes driven by exponential-tailed Lévy noise are important extensions of their Gaussian counterparts in order to capture deviations from Gaussianity, more flexible dependence structures, and sample paths with jumps. Popular examples include non-Gaussian Ornstein--Uhlenbeck processes and type G Matérn stochastic partial differential equation random fields. This paper is concerned with the open problem of determining their extremal dependence structure. We leverage the fact that such processes admit approximations on grids or triangulations that are used in practice for efficient simulations and inference. These approximations can be expressed as special cases of a class of linear transformations of independent, exponential-tailed random variables, that bridge asymptotic dependence and independence in a novel, tractable way. This result is of independent interest since models that can capture both extremal dependence regimes are scarce and the construction of such flexible models is an active area of research. This new fundamental result allows us to show that the integral approximation of general moving average processes with exponential-tailed Lévy noise is asymptotically independent when the mesh is fine enough. Under mild assumptions on the kernel function we also derive the limiting residual tail dependence function. For the popular exponential-tailed Ornstein--Uhlenbeck process we prove that it is asymptotically independent, but with a different residual tail dependence function than its Gaussian counterpart. Our results are illustrated through simulation studies.

Statistics Theory
Large deviations for a class of multivariate heavy-tailed risk processes used in insurance and finance

Miriam Hägele,Jaakko Lehtomaa

DOI: https://doi.org/10.3390/jrfm14050202

2021-03-22

Abstract:Modern risk modelling approaches deal with vectors of multiple components. The components could be, for example, returns of financial instruments or losses within an insurance portfolio concerning different lines of business. One of the main problems is to decide if there is any type of dependence between the components of the vector and, if so, what type of dependence structure should be used for accurate modelling. We study a class of heavy-tailed multivariate random vectors under a non-parametric shape constraint on the tail decay rate. This class contains, for instance, elliptical distributions whose tail is in the intermediate heavy-tailed regime, which includes Weibull and lognormal type tails. The study derives asymptotic approximations for tail events of random walks. Consequently, a full large deviations principle is obtained under, essentially, minimal assumptions. As an application, an optimisation method for a large class of Quota Share (QS) risk sharing schemes used in insurance and finance is obtained.

Probability
On the complete moment convergence of moving average processes generated by negatively dependent random variables under sub-linear expectations

Mingzhou Xu

DOI: https://doi.org/10.3934/math.2024165

2024-01-01

AIMS Mathematics

Abstract:The moving average processes $ X_k = \sum_{i = -\infty}^{\infty}a_{i+k}Y_{i} $ are studied, where $ \{Y_i, -\infty < i < \infty\} $ is a double infinite sequence of negatively dependent random variables under sub-linear expectations, and $ \{a_i, -\infty < i < \infty\} $ is an absolutely summable sequence of real numbers. We establish the complete moment convergence of a moving average process under proper conditions, extending the corresponding results in classic probability space to those in sub-linear expectation space.

mathematics, applied
Large deviations of the giant in supercritical kernel-based spatial random graphs

Joost Jorritsma,Júlia Komjáthy,Dieter Mitsche

2024-04-04

Abstract:We study cluster sizes in supercritical $d$-dimensional inhomogeneous percolation models with long-range edges -- such as long-range percolation -- and/or heavy-tailed degree distributions -- such as geometric inhomogeneous random graphs and the age-dependent random connection model. Our focus is on large deviations of the size of the largest cluster in the graph restricted to a finite box as its volume tends to infinity. Compared to nearest-neighbor Bernoulli bond percolation on $\mathbb{Z}^d$, we show that long edges can increase the exponent of the polynomial speed of the lower tail from $(d-1)/d$ to any $\zeta_\star\in\big((d-1)/d,1\big)$. We prove that this exponent $\zeta_\star$ also governs the size of the second-largest cluster, and the distribution of the size of the cluster containing the origin $\mathcal{C}(0)$.

Probability
Large deviations for Markovian nonlinear Hawkes processes

Lingjiong Zhu

DOI: https://doi.org/10.1214/14-AAP1003

2015-03-17

Abstract:Hawkes process is a class of simple point processes that is self-exciting and has clustering effect. The intensity of this point process depends on its entire past history. It has wide applications in finance, neuroscience and many other fields. In this paper, we study the large deviations for nonlinear Hawkes processes. The large deviations for linear Hawkes processes has been studied by Bordenave and Torrisi. In this paper, we prove first a large deviation principle for a special class of nonlinear Hawkes processes, that is, a Markovian Hawkes process with nonlinear rate and exponential exciting function, and then generalize it to get the result for sum of exponentials exciting functions. We then provide an alternative proof for the large deviation principle for a linear Hawkes process. Finally, we use an approximation approach to prove the large deviation principle for a special class of nonlinear Hawkes processes with general exciting functions.

Probability
Extremal theory for long range dependent infinitely divisible processes

Gennady Samorodnitsky,Yizao Wang

DOI: https://doi.org/10.48550/arXiv.1703.07496

2018-05-22

Abstract:We prove limit theorems of an entirely new type for certain long memory regularly varying stationary infinitely divisible random processes. These theorems involve multiple phase transitions governed by how long the memory is. Apart from one regime, our results exhibit limits that are not among the classical extreme value distributions. Restricted to the one-dimensional case, the distributions we obtain interpolate, in the appropriate parameter range, the $\alpha$-Fréchet distribution and the skewed $\alpha$-stable distribution. In general, the limit is a new family of stationary and self-similar random sup-measures with parameters $\alpha\in(0,\infty)$ and $\beta\in(0,1)$, with representations based on intersections of independent $\beta$-stable regenerative sets. The tail of the limit random sup-measure on each interval with finite positive length is regularly varying with index $-\alpha$. The intriguing structure of these random sup-measures is due to intersections of independent $\beta$-stable regenerative sets and the fact that the number of such sets intersecting simultaneously increases to infinity as $\beta$ increases to one. The results in this paper extend substantially previous investigations where only $\alpha\in(0,2)$ and $\beta\in(0,1/2)$ have been considered.

Probability
Large Deviations for Hamiltonian Systems on Intermediate Time Scales

Shuo Yan

DOI: https://doi.org/10.1142/S0219493722500253

2022-05-23

Abstract:We consider a two-dimensional Hamiltonian system perturbed by a small diffusion term, whose coefficient is state-dependent and non-degenerate. As a result, the process consists of the fast motion along the level curves and slow motion across them. On finite time intervals, the large deviation principle applies, while on time scales that are inversely proportional to the size of the perturbation, the averaging principle holds, i.e., the projection of the process onto the Reeb graph converges to a Markov process. In our paper, we consider the intermediate time scales and prove the large deviation principle, with the action functional determined in terms of the averaged process on the graph.

Probability

Clustering of large deviations in moving average processes: the short memory regime

The effect of memory on functional large deviations of infinite moving average processes

Functional limit theorem for moving average processes generated by dependent random variables

Strong Approximation for Moving Average Processes under Dependence Assumptions

Precise Asymptotics in the Law of the Iterated Logarithm of Moving-Average Processes

Large deviations and applications for Markovian Hawkes processes with a large initial intensity

Large Deviations for High Minima of Gaussian Processes with Nonnegatively Correlated Increments

A framework for the direct evaluation of large deviations in non-Markovian processes

Large Deviations for Empirical Measures of Self-Interacting Markov Chains

Condensation transition in large deviations of self-similar Gaussian processes with stochastic resetting

Large Deviations for Empirical Processes of Interacting Particle Systems

Large deviations principle for a stochastic process with random reinforced relocations

Large Deviations for Small Noise Diffusions Over Long Time

A remarkable example on clustering of extremes for regularly-varying stochastic processes

Extremal Dependence of Moving Average Processes Driven by Exponential-Tailed Lévy Noise

Large deviations for a class of multivariate heavy-tailed risk processes used in insurance and finance

On the complete moment convergence of moving average processes generated by negatively dependent random variables under sub-linear expectations

Large deviations of the giant in supercritical kernel-based spatial random graphs

Large deviations for Markovian nonlinear Hawkes processes

Extremal theory for long range dependent infinitely divisible processes

Large Deviations for Hamiltonian Systems on Intermediate Time Scales