Abstract:We derive some key extremal features for stationary kth-order Markov chains that can be used to understand how the process moves between an extreme state and the body of the process. The chains are studied given that there is an exceedance of a threshold, as the threshold tends to the upper endpoint of the distribution. Unlike previous studies with , we consider processes where standard limit theory describes each extreme event as a single observation without any information about the transition to and from the body of the distribution. Our work uses different asymptotic theory which results in non-degenerate limit laws for such processes. We study the extremal properties of the initial distribution and the transition probability kernel of the Markov chain under weak assumptions for broad classes of extremal dependence structures that cover both asymptotically dependent and asymptotically independent Markov chains. For chains with , the transition of the chain away from the exceedance involves novel functions of the k previous states, in comparison to just the single value, when . This leads to an increase in the complexity of determining the form of this class of functions, their properties, and the method of their derivation in applications. We find that it is possible to derive an affine normalization, dependent on the threshold excess, such that non-degenerate limiting behaviour of the process, in the neighbourhood of the threshold excess, is assured for all lags. We find that these normalization functions have an attractive structure that has parallels to the Yule–Walker equations. Furthermore, the limiting process is always linear in the innovations. We illustrate the results with the study of kth-order stationary Markov chains with exponential margins based on widely studied families of copula dependence structures.

On the Longest Run and the Waiting Time for the First Run in a Continuous Time Multi-State Markov Chain

Waiting times and stopping probabilities for patterns in Markov chains

Markov Chains On Continuous State Space

On exceedance times for some processes with dependent increments

The law of the iterated logarithm for a piecewise deterministic Markov process assured by the properties of the Markov chain given by its post-jump locations

An EM algorithm for continuous-time bivariate Markov chains

Statistical Methods in Markov Chains

Stationary measures of continuous time Markov chains with applications to stochastic reaction networks

Continuous Time Markov Decision Processes with Nonuniformly Bounded Transition Rate: Expected Total Rewards

Long time behavior of semi-Markov modulated perpetuity and some related processes

Long Time Behavior of General Markov Additive Processes

A Unified Approach for Hitting Time of Jump Markov Type Processes

Accurately Computing Expected Visiting Times and Stationary Distributions in Markov Chains

A Markov Chain Approach to the Problem of Runs and Patterns

First Passage Times for Markov Renewal Processes and Applications

Collective marks and first passage times

Nearly unstable family of stochastic processes given by stochastic differential equations with time delay

On the gap and time interval between the first two maxima of long random walks

On regularity of functions of Markov chains

Hidden tail chains and recurrence equations for dependence parameters associated with extremes of stationary higher-order Markov chains

Large deviations for Markov processes with stochastic resetting : analysis via the empirical density and flows or via excursions between resets