Abstract:This paper is an expository survey of the mathematical aspects of statistical inference as it applies to finite Markov chains, the problem being to draw inferences about the transition probabilities from one long, unbroken observation $\{x_1, x_2, \cdots, x_n\}$ on the chain. The topics covered include Whittle's formula, chi-square and maximum-likelihood methods, estimation of parameters, and multiple Markov chains. At the end of the paper it is briefly indicated how these methods can be applied to a process with an arbitrary state space or a continuous time parameter. Section 2 contains a simple proof of Whittle's formula; Section 3 provides an elementary and self-contained development of the limit theory required for the application of chi-square methods to finite chains. In the remainder of the paper, the results are accompanied by references to the literature, rather than by complete proofs. As is usual in a review paper, the emphasis reflects the author's interests. Other general accounts of statistical inference on Markov processes will be found in Grenander [53], Bartlett [9] and [10], Fortet [35], and in my monograph [18]. I would like to thank Paul Meier for a number of very helpful discussions on the topics treated in this paper, particularly those of Section 3.

On regularity of functions of Markov chains

The local properties of the Markov processes of Ornstein-Uhlenbeck type

Regularity of Harmonic Functions for Some Markov Chains with Unbounded Range

A functional limit theorem for coin tossing Markov chains

Asymptotic properties for linear processes of functionals of reversible Markov Chains

On a boundary of the central limit theorem for strictly stationary, reversible Markov chains

Stable limits for Markov chains via the Principle of Conditioning

Markov chains: Structure and applications

On the CLT of additive functionals of Markov chains

Quasi-stationarity and Quasi-Ergodicity of General Markov Processes

Remarks on limit theorems for reversible Markov processes

Markov chains and mappings of distributions on compact spaces

On a limit behavior of a sequence of Markov processes perturbed in a neighborhood of a singular point

Some Probabilistic Properties of General Topological Markov Chains

Multivariate regular variation of heavy-tailed Markov chains

A Note on the Stability of Monotone Markov Chains

Transience and Recurrence of Markov Processes with Constrained Local Time

Conditional Law of Large Numbers and Entropy of Markov Processes

Statistical Methods in Markov Chains

Compressibility and Stochastic Stability of Monotone Markov Chain

Limit theorems for critical branching processes in a finite state space Markovian environment