Abstract:We study the limit behaviour of upper and lower bounds on expected time averages in imprecise Markov chains; a generalised type of Markov chain where the local dynamics, traditionally characterised by transition probabilities, are now represented by sets of `plausible' transition probabilities. Our first main result is a necessary and sufficient condition under which these upper and lower bounds, called upper and lower expected time averages, will converge as time progresses towards infinity to limit values that do not depend on the process' initial state. Our condition is considerably weaker than that needed for ergodic behaviour; a similar notion which demands that marginal upper and lower expectations of functions at a single time instant converge to so-called limit-or steady state-upper and lower expectations. For this reason, we refer to our notion as `weak ergodicity'. Our second main result shows that, as far as this weakly ergodic behaviour is concerned, one should not worry about which type of independence assumption to adopt-epistemic irrelevance, complete independence or repetition independence. The characterisation of weak ergodicity as well as the limit values of upper and lower expected time averages do not depend on such a choice. Notably, this type of robustness is not exhibited by the notion of ergodicity and the related inferences of limit upper and lower expectations. Finally, though limit upper and lower expectations are often used to provide approximate information about the limit behaviour of time averages, we show that such an approximation is sub-optimal and that it can be significantly improved by directly using upper and lower expected time averages.

Refinement bounds for the expected number of renewal epochs over a finite interval

Exponential and Pareto-type bounds for the renewal function and the excess lifetime of a renewal process

Two-sided Bounds for Renewal Equations and Ruin Quantities

A bound on the rate of convergence in the central limit theorem for renewal processes under second moment conditions

Statistics of a Large Number of Renewals in Equilibrium and Non-Equilibrium Renewal Processes

Renewal theorems in a periodic environment

Statistics of the number of renewals, occupation times, and correlation in ordinary, equilibrium, and aging alternating renewal processes

Replicating a renewal process at random times

A Proof of Basic Limit Theorem of Renewal Theory

Renewal theory with fat tailed distributed sojourn times: typical versus rare

On some limit theorems following from Smith's Theorem

An exact test for renewal increasing mean residual life

First order of the renewal covering of the natural numbers

Kemeny's function for Markov chains and Markov renewal processes

Lyapunov exponents of renewal equations: numerical approximation and convergence analysis

From uniform renewal theorem to uniform large and moderate deviations for renewal-reward processes

Properties and conjectures regarding discrete renewal sequences

Average Behaviour in Discrete-Time Imprecise Markov Chains: A Study of Weak Ergodicity

Renewal process with fuzzy interarrival times and rewards

Renewal theory for asymmetric $U$-statistics

Non trivial limit distributions for transient renewal chains