Abstract:We study the limit behaviour of upper and lower bounds on expected time averages in imprecise Markov chains; a generalised type of Markov chain where the local dynamics, traditionally characterised by transition probabilities, are now represented by sets of `plausible' transition probabilities. Our first main result is a necessary and sufficient condition under which these upper and lower bounds, called upper and lower expected time averages, will converge as time progresses towards infinity to limit values that do not depend on the process' initial state. Our condition is considerably weaker than that needed for ergodic behaviour; a similar notion which demands that marginal upper and lower expectations of functions at a single time instant converge to so-called limit-or steady state-upper and lower expectations. For this reason, we refer to our notion as `weak ergodicity'. Our second main result shows that, as far as this weakly ergodic behaviour is concerned, one should not worry about which type of independence assumption to adopt-epistemic irrelevance, complete independence or repetition independence. The characterisation of weak ergodicity as well as the limit values of upper and lower expected time averages do not depend on such a choice. Notably, this type of robustness is not exhibited by the notion of ergodicity and the related inferences of limit upper and lower expectations. Finally, though limit upper and lower expectations are often used to provide approximate information about the limit behaviour of time averages, we show that such an approximation is sub-optimal and that it can be significantly improved by directly using upper and lower expected time averages.

On some limit theorems following from Smith's Theorem

On the Limiting Behaviors of Increments of Sums of Random-Variables Without Moment Conditions

Lindeberg's Central Limit Theorems for Martingale-Like Sequences under Sub-Linear Expectations

Some Limit Theorems for Linear Processes Generated by Symmetrically Exchangeable Random Variables

A martingale view of Blackwell's renewal theorem and its extensions to a general counting process

The Sufficient and Necessary Conditions of the Strong Law of Large Numbers under Sub-Linear Expectations

Refined distributional limit theorems for compound sums

Small time central limit theorems for semimartingales with applications

Renewed Limit Theorems for Noncritical Galton–Watson Branching Systems

Generalized uniform laws for tied-down occupation times of infinite ergodic transformations

Remarks on limit theorems for reversible Markov processes

Stable limits for Markov chains via the Principle of Conditioning

Limit Theorems for Branching Processes with Immigration in a Random Environment

Average Behaviour in Discrete-Time Imprecise Markov Chains: A Study of Weak Ergodicity

Non-stationary version of Ergodic Theorem for random dynamical systems

Spectral methods for limit theorems for random expanding transformations

Non trivial limit distributions for transient renewal chains

On a limit behavior of a sequence of Markov processes perturbed in a neighborhood of a singular point

Limit theorems for random walks in dynamic random environment

Generic extensions of ergodic systems

Limit Theorems for Stochastic Processes