Locally Markov walks on finite graphs

Robin Kaiser,Lionel Levine,Ecaterina Sava-Huss
2024-12-18
Abstract:Locally Markov walks are natural generalizations of classical Markov chains, where instead of a particle moving independently of the past, it decides where to move next depending on the last action performed at the current location. We introduce the concept of locally Markov walks on finite graphs and investigate several basic properties. For a particular locally Markov walk - the uniform unicycle walk on the complete graph - we investigate the mixing time and we prove that it exhibits cutoff.
Probability,Combinatorics
What problem does this paper attempt to address?
The problem that this paper attempts to solve is about the basic properties and behaviors of locally Markov walks on finite graphs. Specifically, the paper mainly focuses on the following points: 1. **Introducing the concept of locally Markov walks**: The paper defines a new random walk model - locally Markov walks. Different from the classical Markov chain, in a locally Markov walk, the next move of a particle depends not only on the current position but also on the action taken at that position last time. 2. **Studying basic properties**: - **Stationary distribution**: The paper explores whether the stationary distribution of locally Markov walks exists and proves that these processes inherit some ergodic properties of the classical Markov chain. - **Eigenvalues, spectral gap and mixing time**: For locally Markov walks on finite graphs, the paper studies properties such as their stationary distribution, eigenvalues, spectral gap and mixing time. 3. **Research on specific examples**: - **Uniform unicycle walk**: The paper specifically studies the uniform unicycle walk on a complete graph, proves that its mixing time exhibits the "cutoff phenomenon", and calculates the spectrum of the transition matrix. ### Specific problem description The core problem of the paper is to explore whether locally Markov walks retain some typical properties of the classical Markov chain, such as the existence and convergence of the stationary distribution. In addition, the paper also studies the behavioral characteristics of these new processes on finite graphs, especially their mixing time and spectral properties. ### Key conclusions - **Theorem 1.1**: For a locally Markov walk \((X_n)_{n\in\mathbb{N}}\) on a finite strongly - connected graph \(G=(V, E)\), if all local chains have strictly positive transition probabilities, then there exists a stationary distribution and converges to this stationary distribution almost surely. - **Theorem 1.2**: The uniform unicycle walk on the complete graph \(K_m\) exhibits the cutoff phenomenon, and the cutoff time is \(m\log(m)\). Through these studies, the paper provides a new perspective for understanding a wider range of random walk models and reveals the unique properties of locally Markov walks.