Polynomials Associated with Finite Markov Chains

Philippe Biane

DOI: https://doi.org/10.1007/978-3-319-18585-9_12

2015-01-01

Lecture notes in mathematics

Abstract:Given a finite Markov chain, we investigate the first minors of the transition matrix of a lifting of this Markov chain to covering trees. In a simple case we exhibit a nice factorisation of these minors, and we conjecture that it holds more generally.

mathematics

What problem does this paper attempt to address?

The Invariance Principle for Some Class of Markov Chains

ZY Lin

DOI: https://doi.org/10.4213/tvp615

2000-01-01

Theory of Probability and Its Applications

Abstract:This work is devoted to the invariance principle for homogeneous Markov chains with a finite state space. The proof is based on a comparison of the asymptotic behavior of sums of random variables constructed by Markov chains with the same transition matrix and various initial distributions.
Markov chains on trees: almost lower and upper directed cases

Luis Fredes,Jean-François Marckert

2024-11-12

Abstract:The transition matrix of a Markov chain $(X_k,k\geq 0)$ on a finite or infinite rooted tree is said to be almost upper-directed if, given $X_k$, the node $X_{k+1}$ is either a descendant of $X_k$ or the parent of $X_k$. It is said to be almost lower-directed if given $X_k$, $X_{k+1}$ is either an ancestor of $X_k$ or a child of $X_k$. These models include nearest neighbor Markov chains on trees. Under an irreducibility assumption, we show that every almost upper-directed transition matrix on infinite (locally finite) trees has some invariant measures. An invariant measure $\pi$ is expressed thanks to a determinantal formula. We give general explicit criteria for recurrence and positive recurrence. An efficient algorithm (the leaf addition algorithm) of independent interest allows $\pi$ to be computed on many trees, without resorting to linear algebra considerations. Flajolet, in a series of papers, provided some relations between continuous fractions, generating functions of weighted Mötzkin paths, and used them in connection with the analysis of birth and death processes. These fruitful representations made it possible to establish many formulae for continuous fractions. Analogous considerations appear here: this type of study can be extended to weighted paths on trees, whose generating functions can also be expressed, this time in terms of multicontinuous fractions.

Probability,Combinatorics
The Harmonic Descent Chain

David J. Aldous,Svante Janson,Xiaodan Li

2024-05-08

Abstract:The decreasing Markov chain on \{1,2,3, \ldots\} with transition probabilities $p(j,j-i) \propto 1/i$ arises as a key component of the analysis of the beta-splitting random tree model. We give a direct and almost self-contained "probability" treatment of its occupation probabilities, as a counterpart to a more sophisticated but perhaps opaque derivation using a limit continuum tree structure and Mellin transforms.

Probability
Elementary Bounds On Mixing Times for Decomposable Markov Chains

Natesh S. Pillai,Aaron Smith

DOI: https://doi.org/10.48550/arXiv.1507.04028

2016-02-03

Abstract:Many finite-state reversible Markov chains can be naturally decomposed into "projection" and "restriction" chains. In this paper we provide bounds on the total variation mixing times of the original chain in terms of the mixing properties of these related chains. This paper is in the tradition of existing bounds on Poincare and log-Sobolev constants of Markov chains in terms of similar decompositions [JSTV04, MR02, MR06, MY09]. Our proofs are simple, relying largely on recent results relating hitting and mixing times of reversible Markov chains [PS13, Oli12]. We describe situations in which our results give substantially better bounds than those obtained by applying existing decomposition results and provide examples for illustration.

Probability
Markov chains, CAT(0) cube complexes, and enumeration: monotone paths in a strip mix slowly

Federico Ardila-Mantilla,Naya Banerjee,Coleson Weir

2024-09-14

Abstract:We prove that two natural Markov chains on the set of monotone paths in a strip mix slowly. To do so, we make novel use of the theory of non-positively curved (CAT(0)) cubical complexes to detect small bottlenecks in many graphs of combinatorial interest. Along the way, we give a formula for the number c_m(n) of monotone paths of length n in a strip of height m. In particular we compute the exponential growth constant of c_m(n) for arbitrary m, generalizing results of Williams for m=2, 3.

Combinatorics,Probability
Finite Markov chains and multiple orthogonal polynomials

Amílcar Branquinho,Juan EF Díaz,Ana Foulquié-Moreno,Manuel Mañas

2024-07-10

Abstract:This paper investigates stochastic finite matrices and the corresponding finite Markov chains constructed using recurrence matrices for general families of orthogonal polynomials and multiple orthogonal polynomials. The paper explores the spectral theory of transition matrices, utilizing both orthogonal and multiple orthogonal polynomials. Several properties are derived, including classes, periodicity, recurrence, stationary states, ergodicity, expected recurrence times, time-reversed chains, and reversibility. Furthermore, the paper uncovers factorization in terms of pure birth and pure death processes. The case study focuses on hypergeometric orthogonal polynomials, where all the computations can be carried out effectively. Particularly within the Askey scheme, all descendants under Hahn (excluding Bessel), such as Hahn, Jacobi, Meixner, Kravchuk, Laguerre, Charlier, and Hermite, present interesting examples of recurrent reversible birth and death finite Markov chains. Additionally, the paper considers multiple orthogonal polynomials, including multiple Hahn, Jacobi-Piñeiro, Laguerre of the first kind, and Meixner of the second kind, along with their hypergeometric representations and derives the corresponding recurrent finite Markov chains and time-reversed chains.

Probability,Mathematical Physics,Classical Analysis and ODEs
Phase Transitions via Complex Extensions of Markov Chains

Jingcheng Liu,Chunyang Wang,Yitong Yin,Yixiao Yu

2024-11-11

Abstract:We study algebraic properties of partition functions, particularly the location of zeros, through the lens of rapidly mixing Markov chains. The classical Lee-Yang program initiated the study of phase transitions via locating complex zeros of partition functions. Markov chains, besides serving as algorithms, have also been used to model physical processes tending to equilibrium. In many scenarios, rapid mixing of Markov chains coincides with the absence of phase transitions (complex zeros). Prior works have shown that the absence of phase transitions implies rapid mixing of Markov chains. We reveal a converse connection by lifting probabilistic tools for the analysis of Markov chains to study complex zeros of partition functions. Our motivating example is the independence polynomial on $k$-uniform hypergraphs, where the best-known zero-free regime has been significantly lagging behind the regime where we have rapidly mixing Markov chains for the underlying hypergraph independent sets. Specifically, the Glauber dynamics is known to mix rapidly on independent sets in a $k$-uniform hypergraph of maximum degree $\Delta$ provided that $\Delta \lesssim 2^{k/2}$. On the other hand, the best-known zero-freeness around the point $1$ of the independence polynomial on $k$-uniform hypergraphs requires $\Delta \le 5$, the same bound as on a graph. By introducing a complex extension of Markov chains, we lift an existing percolation argument to the complex plane, and show that if $\Delta \lesssim 2^{k/2}$, the Markov chain converges in a complex neighborhood, and the independence polynomial itself does not vanish in the same neighborhood. In the same regime, our result also implies central limit theorems for the size of a uniformly random independent set, and deterministic approximation algorithms for the number of hypergraph independent sets of size $k \le \alpha n$ for some constant $\alpha$.

Data Structures and Algorithms,Discrete Mathematics,Probability
On cover times of Markov chains

Bruno Sericola

DOI: https://doi.org/10.1080/15326349.2024.2319201

2024-03-14

Stochastic Models

Abstract:We consider the cover time of a discrete-time homogenous Markov chain, which is the time needed by the Markov chain to visit all its states. We analyze both the distribution and the moments of the cover time, and we are interested in exact results instead of asymptotic values of the mean cover time, which are generally considered in the literature. We first obtain several general results on the hitting time and the cover time of a subset of the state space, both in terms of distribution and moments. These results are then applied to particular graphs, namely the generalized cycle graph, the complete graph, and the generalized path graph. They lead to recurrence or analytic relations for the distribution and the mean value of their cover times.

statistics & probability
Hopf algebras and Markov chains: two examples and a theory

Persi Diaconis,C. Y. Amy Pang,Arun Ram

DOI: https://doi.org/10.1007/s10801-013-0456-7

2013-06-18

Journal of Algebraic Combinatorics

Abstract:The operation of squaring (coproduct followed by product) in a combinatorial Hopf algebra is shown to induce a Markov chain in natural bases. Chains constructed in this way include widely studied methods of card shuffling, a natural “rock-breaking” process, and Markov chains on simplicial complexes. Many of these chains can be explicitly diagonalized using the primitive elements of the algebra and the combinatorics of the free Lie algebra. For card shuffling, this gives an explicit description of the eigenvectors. For rock-breaking, an explicit description of the quasi-stationary distribution and sharp rates to absorption follow.

mathematics
Compressing redundant information in Markov chains

Giacomo Aletti

DOI: https://doi.org/10.48550/arXiv.math/0605099

2006-05-03

Probability

Abstract:Given a strongly stationary Markov chain and a finite set of stopping rules, we prove the existence of a polynomial algorithm which projects the Markov chain onto a minimal Markov chain without redundant information. Markov complexity is hence defined and tested on some classical problems.
Markov Bases: A 25 Year Update

Félix Almendra-Hernández,Jesús A. DeLoera,Sonja Petrović,Jesús A. De Loera

DOI: https://doi.org/10.1080/01621459.2024.2310181

IF: 4.369

2024-03-10

Journal of the American Statistical Association

Abstract:In this article, we evaluate the challenges and best practices associated with the Markov bases approach to sampling from conditional distributions. We provide insights and clarifications after 25 years of the publication of the Fundamental theorem for Markov bases by Diaconis and Sturmfels. In addition to a literature review, we prove three new results on the complexity of Markov bases in hierarchical models, relaxations of the fibers in log-linear models, and limitations of partial sets of moves in providing an irreducible Markov chain. Supplementary materials for this article are available online.

statistics & probability
Tensor product Markov chains and Weil representations

Jason Fulman,Michael Larsen,Pham Huu Tiep

2024-07-18

Abstract:We obtain sharp bounds on the convergence rate of Markov chains on irreducible representations of finite general linear, unitary, and symplectic groups (in both odd and even characteristic) given by tensoring with Weil representations.

Representation Theory,Combinatorics,Probability
Ergodic theorem for branching Markov chains indexed by trees with arbitrary shape

Julien Weibel

2024-03-25

Abstract:We prove an ergodic theorem for Markov chains indexed by the Ulam-Harris-Neveu tree over large subsets with arbitrary shape under two assumptions: with high probability, two vertices in the large subset are far from each other and have their common ancestor close to the root. The assumption on the common ancestor can be replaced by some regularity assumption on the Markov transition kernel. We verify that those assumptions are satisfied for some usual trees. Finally, with Markov-Chain Monte-Carlo considerations in mind, we prove when the underlying Markov chain is stationary and reversible that the Markov chain, that is the line graph, yields minimal variance for the empirical average estimator among trees with a given number of nodes.

Probability
The Markov-Chain Polytope with Applications

Mordecai J. Golin,Albert John Lalim Patupat

2024-08-17

Abstract:This paper addresses the problem of finding a minimum-cost $m$-state Markov chain $(S_0,\ldots,S_{m-1})$ in a large set of chains. The chains studied have a reward associated with each state. The cost of a chain is its "gain", i.e., its average reward under its stationary distribution. Specifically, for each $k=0,\ldots,m-1$ there is a known set ${\mathbb S}_k$ of type-$k$ states. A permissible Markov chain contains exactly one state of each type; the problem is to find a minimum-cost permissible chain. The original motivation was to find a cheapest binary AIFV-$m$ lossless code on a source alphabet of size $n$. Such a code is an $m$-tuple of trees, in which each tree can be viewed as a Markov Chain state. This formulation was then used to address other problems in lossless compression. The known solution techniques for finding minimum-cost Markov chains were iterative and ran in exponential time. This paper shows how to map every possible type-$k$ state into a type-$k$ hyperplane and then define a "Markov Chain Polytope" as the lower envelope of all such hyperplanes. Finding a minimum-cost Markov chain can then be shown to be equivalent to finding a "highest" point on this polytope. The local optimization procedures used in the previous iterative algorithms are shown to be separation oracles for this polytope. Since these were often polynomial time, an application of the Ellipsoid method immediately leads to polynomial time algorithms for these problems.

Information Theory
On bounded ratios of minors of totally positive matrices

Daniel Soskin,Michael Gekhtman

DOI: https://doi.org/10.48550/arXiv.2204.11962

2023-10-23

Abstract:We provide several examples of bounded Laurent monomials of minors of a totally positive matrix, which can not be factored into a product of so called primitive ratios, thus showing that the conjecture about factorization of bounded ratios stated in [3] by Fallat, Gekhtman, and Johnson does not hold. However, all found examples satisfy subtraction-free conjecture stated also in [3]. In addition, we show that the set of all bounded ratios form a polyhedral cone of dimension $\binom{2n}{n}-2n$.

Rings and Algebras,Combinatorics
Rowmotion Markov chains

Colin Defant,Rupert Li,Evita Nestoridi

DOI: https://doi.org/10.1016/j.aam.2023.102666

IF: 1.271

2024-04-01

Advances in Applied Mathematics

Abstract:Rowmotion is a certain well-studied bijective operator on the distributive lattice J ( P ) of order ideals of a finite poset P. We introduce the rowmotion Markov chain M J ( P ) by assigning a probability p x to each x ∈ P and using these probabilities to insert randomness into the original definition of rowmotion. More generally, we introduce a very broad family of toggle Markov chains inspired by Striker's notion of generalized toggling. We characterize when toggle Markov chains are irreducible, and we show that each toggle Markov chain has a remarkably simple stationary distribution. We also provide a second generalization of rowmotion Markov chains to the context of semidistrim lattices. Given a semidistrim lattice L, we assign a probability p j to each join-irreducible element j of L and use these probabilities to construct a rowmotion Markov chain M L . Under the assumption that each probability p j is strictly between 0 and 1, we prove that M L is irreducible. We also compute the stationary distribution of the rowmotion Markov chain of a lattice obtained by adding a minimal element and a maximal element to a disjoint union of two chains. We bound the mixing time of M L for an arbitrary semidistrim lattice L. In the special case when L is a Boolean lattice, we use spectral methods to obtain much stronger estimates on the mixing time, showing that rowmotion Markov chains of Boolean lattices exhibit the cutoff phenomenon.

mathematics, applied
Various proofs of the Fundamental Theorem of Markov Chains

Somenath Biswas

DOI: https://doi.org/10.48550/arXiv.2204.00784

2022-04-02

Abstract:This paper is a survey of various proofs of the so called {\em fundamental theorem of Markov chains}: every ergodic Markov chain has a unique positive stationary distribution and the chain attains this distribution in the limit independent of the initial distribution the chain started with. As Markov chains are stochastic processes, it is natural to use probability based arguments for proofs. At the same time, the dynamics of a Markov chain is completely captured by its initial distribution, which is a vector, and its transition probability matrix. Therefore, arguments based on matrix analysis and linear algebra can also be used. The proofs discussed below use one or the other of these two types of arguments, except in one case where the argument is graph theoretic. Appropriate credits to the various proofs are given in the main text. Our first proof is entirely elementary, and yet the proof is also quite simple. The proof also suggests a mixing time bound, which we prove, but this bound in many cases will not be the best bound. One approach in proving the fundamental theorem breaks the proof in two parts: (i) show the existence of a unique positive stationary distribution for irreducible Markov chains, and (ii) assuming that an ergodic chain does have a stationary distribution, show that the chain will converge in the limit to that distribution irrespective of the initial distribution. For (i), we survey two proofs, one uses probability arguments, and the other uses graph theoretic arguments. For (ii), first we give a coupling based proof (coupling is a probability based technique), the other uses matrix analysis. Finally, we give a proof of the fundamental theorem using only linear algebra concepts.

Probability,Data Structures and Algorithms
Cutting down trees with a Markov chainsaw

Louigi Addario-Berry,Nicolas Broutin,Cecilia Holmgren

DOI: https://doi.org/10.1214/13-AAP978

2014-09-05

Abstract:We provide simplified proofs for the asymptotic distribution of the number of cuts required to cut down a Galton-Watson tree with critical, finite-variance offspring distribution, conditioned to have total progeny $n$. Our proof is based on a coupling which yields a precise, nonasymptotic distributional result for the case of uniformly random rooted labeled trees (or, equivalently, Poisson Galton-Watson trees conditioned on their size). Our approach also provides a new, random reversible transformation between Brownian excursion and Brownian bridge.

Probability,Combinatorics
Markov chains and mappings of distributions on compact spaces II: Numerics and Conjectures

David J. Aldous,Madelyn Cruz,Shi Feng

2024-03-27

Abstract:Consider a compact metric space $S$ and a pair $(j,k)$ with $k \ge 2$ and $1 \le j \le k$. For any probability distribution $\theta \in P(S)$, define a Markov chain on $S$ by: from state $s$, take $k$ i.i.d. ($\theta$) samples, and jump to the $j$'th closest. Such a chain converges in distribution to a unique stationary distribution, say $\pi_{j,k}(\theta)$. This defines a mapping $\pi_{j,k}: P(S) \to P(S)$. What happens when we iterate this mapping? In particular, what are the fixed points of this mapping? A few results are proved in a companion article; this article, not intended for formal publication, records numerical studies and conjectures.

Probability
A Matrix Chernoff Bound for Markov Chains and Its Application to Co-Occurrence Matrices

Jiezhong Qiu,Chi Wang,Ben Liao,Richard Peng,Jie Tang

2020-01-01

Abstract:We prove a Chernoff-type bound for sums of matrix-valued random variables sampled via a regular (aperiodic and irreducible) finite Markov chain. Specially, consider a random walk on a regular Markov chain and a Hermitian matrix-valued function on its state space. Our result gives exponentially decreasing bounds on the tail distributions of the extreme eigenvalues of the sample mean matrix. Our proof is based on the matrix expander (regular undirected graph) Chernoff bound [Garg et al. STOC '18] and scalar Chernoff-Hoeffding bounds for Markov chains [Chung et al. STACS '12]. Our matrix Chernoff bound for Markov chains can be applied to analyze the behavior of co-occurrence statistics for sequential data, which have been common and important data signals in machine learning. We show that given a regular Markov chain with n states and mixing time τ, we need a trajectory of length O (τ (log n + log τ)/ε 2 ) to achieve an estimator of the co-occurrence matrix with error bound ε. We conduct several experiments and the experimental results are consistent with the exponentially fast convergence rate from theoretical analysis. Our result gives the first bound on the convergence rate of the co-occurrence matrix and the first sample complexity analysis in graph representation learning.

Polynomials Associated with Finite Markov Chains

The Invariance Principle for Some Class of Markov Chains

Markov chains on trees: almost lower and upper directed cases

The Harmonic Descent Chain

Elementary Bounds On Mixing Times for Decomposable Markov Chains

Markov chains, CAT(0) cube complexes, and enumeration: monotone paths in a strip mix slowly

Finite Markov chains and multiple orthogonal polynomials

Phase Transitions via Complex Extensions of Markov Chains

On cover times of Markov chains

Hopf algebras and Markov chains: two examples and a theory

Compressing redundant information in Markov chains

Markov Bases: A 25 Year Update

Tensor product Markov chains and Weil representations

Ergodic theorem for branching Markov chains indexed by trees with arbitrary shape

The Markov-Chain Polytope with Applications

On bounded ratios of minors of totally positive matrices

Rowmotion Markov chains

Various proofs of the Fundamental Theorem of Markov Chains

Cutting down trees with a Markov chainsaw

Markov chains and mappings of distributions on compact spaces II: Numerics and Conjectures

A Matrix Chernoff Bound for Markov Chains and Its Application to Co-Occurrence Matrices