Abstract:This paper is an expository survey of the mathematical aspects of statistical inference as it applies to finite Markov chains, the problem being to draw inferences about the transition probabilities from one long, unbroken observation $\{x_1, x_2, \cdots, x_n\}$ on the chain. The topics covered include Whittle's formula, chi-square and maximum-likelihood methods, estimation of parameters, and multiple Markov chains. At the end of the paper it is briefly indicated how these methods can be applied to a process with an arbitrary state space or a continuous time parameter. Section 2 contains a simple proof of Whittle's formula; Section 3 provides an elementary and self-contained development of the limit theory required for the application of chi-square methods to finite chains. In the remainder of the paper, the results are accompanied by references to the literature, rather than by complete proofs. As is usual in a review paper, the emphasis reflects the author's interests. Other general accounts of statistical inference on Markov processes will be found in Grenander [53], Bartlett [9] and [10], Fortet [35], and in my monograph [18]. I would like to thank Paul Meier for a number of very helpful discussions on the topics treated in this paper, particularly those of Section 3.

Limit Theorems for quadratic forms of Markov Chains

Strong Approximations of Martingale Vectors and Their Applications in Markov-Chain Adaptive Designs

Remarks on limit theorems for reversible Markov processes

Lindeberg's Central Limit Theorems for Martingale-Like Sequences under Sub-Linear Expectations

Limit Theorems and Inequalities Via Martingale Methods

Stable limits for Markov chains via the Principle of Conditioning

A functional limit theorem for coin tossing Markov chains

Asymptotic properties for linear processes of functionals of reversible Markov Chains

Asymptotics of Markov Kernels and the Tail Chain

On the CLT of additive functionals of Markov chains

Small time central limit theorems for semimartingales with applications

A calculus for Markov chain Monte Carlo: studying approximations in algorithms

Fluctuations of Interacting Markov Chain Monte Carlo Methods

On a boundary of the central limit theorem for strictly stationary, reversible Markov chains

Formal Error Bounds for the State Space Reduction of Markov Chains

Statistical Methods in Markov Chains

A Useful Version of the Central Limit Theorem for a General Class of Markov Chains

Some Strong Limit Theorems for two Orders Markov Chains on a Special Kind of Non-Homogeneous Tree

Rademacher complexity for Markov chains : Applications to kernel smoothing and Metropolis-Hasting

Limit Theorems for Marked Hawkes Processes with Application to a Risk Model

Limit theory for controlled McKean-Vlasov dynamics