Strong times and first hitting

Francesco Manzo,Elisabetta Scoppola

DOI: https://doi.org/10.48550/arXiv.1606.07244

2016-06-23

Probability

Abstract:We generalize the notion of strong stationary time and we give a representation formula for the hitting time to a target set in the general case of non-reversible Markov processes.

What problem does this paper attempt to address?

On strong stationary times and approximation of Markov chain hitting times by geometric sums

Fraser Daly

DOI: https://doi.org/10.1016/j.spl.2019.02.017

2019-07-01

Abstract:For discrete-time, ergodic Markov chains started from stationarity, Fill and Lyzinski (2014) showed that hitting times may sometimes be represented as geometric sums. We extend this, giving explicit bounds in the approximation of hitting times by appropriately chosen geometric sums.

statistics & probability
Strong Approximation for A Class of Stationary Processes

Weidong Liu,Zhengyan Lin

DOI: https://doi.org/10.1016/j.spa.2008.01.012

IF: 1.43

2009-01-01

Stochastic Processes and their Applications

Abstract:Strong approximation for sums of a class of stationary processes with optimal bound is established. The main tools are m-dependent approximation and block techniques. Some previous results are improved.
Spectral properties of the strongly assortative stochastic block model and their application to hitting times of random walks

Matthias Löwe,Sara Terveer

2024-01-17

Abstract:We analyze hitting times of simple random walk on realizations of the stochastic block model. We show that under some natural assumptions the average starting hitting time as well as the average target hitting time are asymptotically almost surely given by $N(1+o(1))$. We also show a central limit theorem for the average target hitting time. Our main techniques are a spectral decomposition of these hitting times, a spectral analysis of the adjacency matrix and the graph Laplacian, respectively, as well as a form of the Delta method.

Probability
Mixing Times and Moving Targets

PERLA SOUSI,PETER WINKLER

DOI: https://doi.org/10.1017/s0963548313000539

2013-11-14

Abstract:We consider irreducible Markov chains on a finite state space. We show that the mixing time of any such chain is equivalent to the maximum, over initial states x and moving large sets ( A s ) s , of the hitting time of ( A s ) s starting from x . We prove that in the case of the d -dimensional torus the maximum hitting time of moving targets is equal to the maximum hitting time of stationary targets. Nevertheless, we construct a transitive graph where these two quantities are not equal, resolving an open question of Aldous and Fill on a ‘cat and mouse’ game.
Strong stationary times for features of random walks

Graham White

DOI: https://doi.org/10.48550/arXiv.1910.03837

2019-10-09

Abstract:In [4], we examined the use of coupling to obtain bounds on the mixing time of statistics on Markov chains. In the present paper, we consider the same general problem, but using strong stationary times rather than coupling. We discuss various types of behaviour that may occur when this is attempted, and analyse a variety of examples.

Probability
On the laws of first hitting times of points for one-dimensional symmetric stable Lévy processes

Kouji Yano,Yuko Yano,Marc Yor

DOI: https://doi.org/10.48550/arXiv.0811.2046

2008-11-13

Abstract:Several aspects of the laws of first hitting times of points are investigated for one-dimensional symmetric stable Lévy processes. Itô's excursion theory plays a key role in this study.

Probability
On Hitting Times for General Quantum Markov Processes

Lorenzo Laneve,Francesco Tacchino,Ivano Tavernelli

DOI: https://doi.org/10.22331/q-2023-07-12-1056

2023-07-06

Abstract:Random walks (or Markov chains) are models extensively used in theoretical computer science. Several tools, including analysis of quantities such as hitting and mixing times, are helpful for devising randomized algorithms. A notable example is Schöning's algorithm for the satisfiability (SAT) problem. In this work, we use the density-matrix formalism to define a quantum Markov chain model which directly generalizes classical walks, and we show that a common tools such as hitting times can be computed with a similar formula as the one found in the classical theory, which we then apply to known quantum settings such as Grover's algorithm.

Quantum Physics,Data Structures and Algorithms,Probability
Quasi-stationary distributions of non-absorbing Markov chains

Roberto Fernandez,Francesco Manzo,Matteo Quattropani,Elisabetta Scoppola

2024-09-28

Abstract:We consider reversible ergodic Markov chains with finite state space, and we introduce a new notion of quasi-stationary distribution that does not require the presence of any absorbing state. In our setting, the hitting time of the absorbing set is replaced by an optimal strong stationary time, representing the ``hitting time of the stationary distribution''. On the one hand, we show that our notion of quasi-stationary distribution corresponds to the natural generalization of the \emph{Yaglom limit}. On the other hand, similarly to the classical quasi-stationary distribution, we show that it can be written in terms of the eigenvectors of the underlying Markov kernel, and it is therefore amenable of a geometric interpretation. Moreover, we recover the usual exponential behavior that characterizes quasi-stationary distributions and metastable systems. We also provide some toy examples, which show that the phenomenology is richer compared to the absorbing case. Finally, we present some counterexamples, showing that the assumption on the reversibility cannot be weakened in general.

Probability,Mathematical Physics
Hitting time statistics for observations of dynamical systems

Jerome Rousseau

DOI: https://doi.org/10.1088/0951-7715/27/9/2377

2014-07-25

Abstract:In this paper we study the distribution of hitting and return times for observations of dynamical systems. We apply this results to get an exponential law for the distribution of hitting and return times for rapidly mixing random dynamical systems. In particular, it allows us to obtain an exponential law for random expanding maps, random circle maps expanding in average and randomly perturbed dynamical systems.

Dynamical Systems
STRONG APPROXIMATION OF A MARKOV CHAIN

Zhengyan LIN,Lixin ZHANG,Siu CHEUNG,Wai CHAN

DOI: https://doi.org/10.3321/j.issn:1000-8134.2005.02.011

2005-01-01

Abstract:The strong approximations of a class of non-homogenous Markov chains by Wiener processes are considered. As an application, the strong consistency, the law of the iterated logarithm and the weak convergence are established for the Markov chain adaptive designs in clinical trials.
Strongly constrained stochastic processes: the multi-ends Brownian bridge

Coline Larmier,Alain Mazzolo,Andrea Zoia

DOI: https://doi.org/10.1088/1742-5468/ab4bbc

2019-09-27

Abstract:In a recent article, Krapivsky and Redner (J. Stat. Mech. 093208 (2018)) established that the distribution of the first hitting times for a diffusing particle subject to hitting an absorber is independent of the direction of the external flow field. In the present paper, we build upon this observation and investigate when the conditioning on the diffusion leads to a process that is totally independent of the flow field. For this purpose, we adopt the Langevin approach, or more formally the theory of conditioned stochastic differential equations. This technique allows us to derive a large variety of stochastic processes: in particular, we introduce a new kind of Brownian bridge ending at two different final points and calculate its fundamental probabilities. This method is also very well suited for generating statistically independent paths. Numerical simulations illustrate our findings.

Physics
A Unified Approach for Hitting Time of Jump Markov Type Processes

Nikolaos Limnios,Bei Wu

DOI: https://doi.org/10.1007/s11009-024-10100-2

2024-08-19

Methodology And Computing In Applied Probability

Abstract:This paper investigates the asymptotic analysis of the hitting time of Markov-type jump processes (i.e., semi-Markov, Markov, in continuous or discrete time) with a small probability of entering a non-empty terminal subset. This means that absorption is a rare event. The mean hitting time function of all four type processes obeyed the same equation. We obtain unified results of asymptotic approximation in a series scheme or, equivalently, a functional type of mean hitting time.

statistics & probability
First Hitting Time Analysis of the Independence Metropolis Sampler

Romeo Maciuca,Song-Chun Zhu

DOI: https://doi.org/10.1007/s10959-006-0002-9

2006-01-01

Journal of Theoretical Probability

Abstract:In this paper, we study a special case of the Metropolis algorithm, the Independence Metropolis Sampler (IMS), in the finite state space case. The IMS is often used in designing components of more complex Markov Chain Monte Carlo algorithms. We present new results related to the first hitting time of individual states for the IMS. These results are expressed mostly in terms of the eigenvalues of the transition kernel. We derive a simple form formula for the mean first hitting time and we show tight lower and upper bounds on the mean first hitting time with the upper bound being the product of two factors: a “local” factor corresponding to the target state and a “global” factor, common to all the states, which is expressed in terms of the total variation distance between the target and the proposal probabilities. We also briefly discuss properties of the distribution of the first hitting time for the IMS and analyze its variance. We conclude by showing how some non-independence Metropolis–Hastings algorithms can perform better than the IMS and deriving general lower and upper bounds for the mean first hitting times of a Metropolis–Hastings algorithm.
On cover times of Markov chains

Bruno Sericola

DOI: https://doi.org/10.1080/15326349.2024.2319201

2024-03-14

Stochastic Models

Abstract:We consider the cover time of a discrete-time homogenous Markov chain, which is the time needed by the Markov chain to visit all its states. We analyze both the distribution and the moments of the cover time, and we are interested in exact results instead of asymptotic values of the mean cover time, which are generally considered in the literature. We first obtain several general results on the hitting time and the cover time of a subset of the state space, both in terms of distribution and moments. These results are then applied to particular graphs, namely the generalized cycle graph, the complete graph, and the generalized path graph. They lead to recurrence or analytic relations for the distribution and the mean value of their cover times.

statistics & probability
Relaxation times are stationary hitting times of large sets

Jonathan Hermon

2023-04-12

Abstract:We give a characterization of the relaxation time up to an absolute constant factor, in terms of stationary expected hitting times of large sets. This resolves a conjecture of Aldous and Fill. We give a similar characterization for the spectral profile. We also provide in the non-reversible setup a related characterization for stationary expected hitting times of large sets.

Probability
Hitting time expressions for quantum channels: beyond the irreducible case and applications to unitary walks

C. F. Lardizabal,L. F. L. Pereira

DOI: https://doi.org/10.1007/s11128-023-04062-6

2023-07-18

Abstract:In this work we make use of generalized inverses associated with quantum channels acting on finite-dimensional Hilbert spaces, so that one may calculate the mean hitting time for a particle to reach a chosen goal subspace. The questions studied in this work are motivated by recent results on quantum dynamics on graphs, most particularly quantum Markov chains. We focus on describing how generalized inverses and hitting times can be obtained, with the main novelties of this work with respect to previous ones being that a) we are able to weaken the notion of irreducibility, so that reducible examples can be considered as well, and b) one may consider arbitrary arrival subspaces for general positive, trace preserving maps. Natural examples of reducible maps are given by unitary quantum walks. We also take the opportunity to explain how a more specific inverse, namely the group inverse, appears in our context, in connection with matrix algebraic constructions which may be of independent interest.

Quantum Physics,Mathematical Physics
Hitting times in the stochastic block model

Andrea Ottolini

2024-02-15

Abstract:Given a large connected graph $G=(V,E)$, and two vertices $w,\neq v$, let $T_{w,v}$ be the first hitting time to $v$ starting from $w$ for the simple random walk on $G$. We prove a general theorem that guarantees, under some assumptions on $G$, to approximate $\mathbb E[T_{w,v}]$ up to $o(1)$ terms. As a corollary, we derive explicit formulas for the stochastic block model with two communities and connectivity parameters $p$ and $q$, and show that the average hitting times, for fixed $v$ and as $w$ varies, concentrates around four possible values. The proof is purely probabilistic and uses a coupling argument.

Probability,Combinatorics
Finiteness of hitting times under taboo

Ekaterina Vl. Bulinskaya

DOI: https://doi.org/10.1016/j.spl.2013.10.016

2013-10-26

Abstract:We consider a continuous-time Markov chain with a finite or countable state space. For a site y and subset H of the state space, the hitting time of y under taboo H is defined to be infinite if the process trajectory hits H before y, and the first hitting time of y otherwise. We investigate the probability that such times are finite. In particular, if the taboo set is finite, an efficient iterative scheme reduces the study to the known case of a singleton taboo. A similar procedure applies in the case of finite complement of the taboo set. The study is motivated by classification of branching processes with finitely many catalysts. Keywords and phrases: Markov chain, hitting time, taboo probabilities, catalytic branching process.

Probability
Diffusion hitting times and the bell-shape

Wissem Jedidi,Thomas Simon

DOI: https://doi.org/10.1016/j.spl.2015.03.008

2015-07-01

Abstract:Consider a generalized diffusion on R with speed measure m, in the natural scale. It is known that the conditional hitting times have a unimodal density function. We show that these hitting densities are bell-shaped if and only if m has infinitely many points of increase between the starting point and the hit point. This result can be viewed as a visual corollary to Yamazato’s general factorization for diffusion hitting times.

statistics & probability
Stochastic ordering for hitting times of fractional Brownian motions

Ulises Pérez-Cendejas,Gerardo Pérez-Suárez

DOI: https://doi.org/10.1016/j.spl.2024.110053

IF: 0.718

2024-01-26

Statistics & Probability Letters

Abstract:In this note we prove that, under a suitable transformation, the hitting times of fractional Brownian motions (fBMs) can be ordered stochastically. As a consequence, we derive upper and lower bounds for their cumulative distribution function. We also study some properties, such as continuity and monotonicity, of the probability tail and of the expectation of the supremum of fBMs seen as functions of the Hurst index H . We apply these properties to provide alternative proofs of some results known for fBM.

statistics & probability

Strong times and first hitting

On strong stationary times and approximation of Markov chain hitting times by geometric sums

Strong Approximation for A Class of Stationary Processes

Spectral properties of the strongly assortative stochastic block model and their application to hitting times of random walks

Mixing Times and Moving Targets

Strong stationary times for features of random walks

On the laws of first hitting times of points for one-dimensional symmetric stable Lévy processes

On Hitting Times for General Quantum Markov Processes

Quasi-stationary distributions of non-absorbing Markov chains

Hitting time statistics for observations of dynamical systems

STRONG APPROXIMATION OF A MARKOV CHAIN

Strongly constrained stochastic processes: the multi-ends Brownian bridge

A Unified Approach for Hitting Time of Jump Markov Type Processes

First Hitting Time Analysis of the Independence Metropolis Sampler

On cover times of Markov chains

Relaxation times are stationary hitting times of large sets

Hitting time expressions for quantum channels: beyond the irreducible case and applications to unitary walks

Hitting times in the stochastic block model

Finiteness of hitting times under taboo

Diffusion hitting times and the bell-shape

Stochastic ordering for hitting times of fractional Brownian motions