Abstract:First passage of stochastic processes under resetting has recently been an active research topic in the field of statistical physics. However, most of previous studies mainly focused on the systems with continuous time and space. In this paper, we study the effect of stochastic resetting on first passage properties of discrete-time absorbing Markov chains, described by a transition matrix $\brm{Q}$ between transient states and a transition matrix $\brm{R}$ from transient states to absorbing states. Using a renewal approach, we exactly derive the unconditional mean first passage time (MFPT) to either of absorbing states, the splitting probability the and conditional MFPT to each absorbing state. All the quantities can be expressed in terms of a deformed fundamental matrix $\brm{Z_{\gamma}}=\left[\brm{I}-(1-\gamma) \brm{Q} \right]^{-1}$ and $\brm{R}$, where $\brm{I}$ is the identity matrix, and $\gamma$ is the resetting probability at each time step. We further show a sufficient condition under which the unconditional MPFT can be optimized by stochastic resetting. Finally, we apply our results to two concrete examples: symmetric random walks on one-dimensional lattices with absorbing boundaries and voter model on complete graphs.

Block-Structured Markov Renewal Processes

Markov Chains Of Gi/G/1 Type

Two Types of RG-Factorizations of Quasi-birth-and-death Processes and Their Applications to Stochastic Integral Functionals

Two Types of RG-Factorizations of Continuous-Time Level-Dependent Quasi-Birth-and-Death Processes and Their Applications to Stochastic Integral Functionals

GTH Algorithm, Censored Markov Chains, and $RG$-Factorization

Light-Tailed Asymptotics of Stationary Probability Vectors of Markov Chains of Gi/G/1 Type

Blockwise Perturbation Theory for Markov Chains

One-sided Markov additive processes with lattice and non-lattice increments

Markov Chains On Continuous State Space

Some characterizations for Markov processes as mixed renewal processes

Continuous-Time QBD Processes with Continuous Phase Variable

First passage in discrete-time absorbing Markov chains under stochastic resetting

A Computational Framework for the Mixing Times in the QBD Processes with Infinitely-Many Levels

A fractional generalization of the Poisson processes

Asymptotic Results of a Multiple-entry Reinforcement Process

Renewal and Regenerative Processes: short review

Blockwise perturbation theory for nearly uncoupled Markov chains and its application

Block-Structured Fluid Queues Driven by Qbd Processes

Block-structured Stochastic Process Algebra and Its Applications to Queueing Systems

Quasi-stationary distributions for continuous-time $λ$-recurrent jump processes

Stabilization of Singular Markovian Jump Systems With Generally Uncertain Transition Rates