Abstract:First passage of stochastic processes under resetting has recently been an active research topic in the field of statistical physics. However, most of previous studies mainly focused on the systems with continuous time and space. In this paper, we study the effect of stochastic resetting on first passage properties of discrete-time absorbing Markov chains, described by a transition matrix $\brm{Q}$ between transient states and a transition matrix $\brm{R}$ from transient states to absorbing states. Using a renewal approach, we exactly derive the unconditional mean first passage time (MFPT) to either of absorbing states, the splitting probability the and conditional MFPT to each absorbing state. All the quantities can be expressed in terms of a deformed fundamental matrix $\brm{Z_{\gamma}}=\left[\brm{I}-(1-\gamma) \brm{Q} \right]^{-1}$ and $\brm{R}$, where $\brm{I}$ is the identity matrix, and $\gamma$ is the resetting probability at each time step. We further show a sufficient condition under which the unconditional MPFT can be optimized by stochastic resetting. Finally, we apply our results to two concrete examples: symmetric random walks on one-dimensional lattices with absorbing boundaries and voter model on complete graphs.

The first returning speed and the last exit speed of a type of Markov chain

Higher Order Ergodic Markov Chains and First Passage Times

Recurrence for branching Markov chains

Reversibility and Entropy Production of Inhomogeneous Markov Chains

The critical Branching Markov Chain is transient

n-type Markov Branching Processes with Immigration

A note on discrete-time markov chains

Extinction behavior and recurrence of n-type Markov branching–immigration processes

The Key Renewal Theorem for a Transient Markov Chain

Advanced method and application on Markov state transfer chain

Waiting times and stopping probabilities for patterns in Markov chains

Asymptotic period of an aperiodic Markov chain

Collective marks and first passage times

First Passage Times for Markov Renewal Processes and Applications

On the quasi-ergodicity of absorbing Markov chains with unbounded transition densities, including random logistic maps with escape

Recurrence and transience of a Markov chain on + and evaluation of prior distributions for a Poisson mean

Anomalous Recurrence Properties of Markov Chains on Manifolds of Negative Curvature

First passage in discrete-time absorbing Markov chains under stochastic resetting

Α–transience and Α–recurrence of Right Processes

Exit Times for a Discrete Markov Additive Process

Cutoff for mixtures of permuted Markov chains: reversible case