A.S. convergence for infinite colour Pólya urns associated with stable random walks

Arthur Blanc-Renaudie

2024-02-10

Abstract:We answer Problem 11.1 of Janson <a class="link-https" data-arxiv-id="1803.04207" href="https://arxiv.org/abs/1803.04207">arXiv:1803.04207</a> on Pólya urns associated with stable random walk. Our proof use neither martingales nor trees, but an approximation with a differential equation.

Probability

What problem does this paper attempt to address?

Asymptotic Properties of Multicolor Randomly Reinforced Pólya Urns

Li-Xin Zhang,Feifang Hu,Siu Hung Cheung,Wai Sum Chan

DOI: https://doi.org/10.1239/aap/1401369708

2014-01-01

Abstract:The generalized Pólya urn has been extensively studied and is widely applied in many disciplines. An important application of urn models is in the development of randomized treatment allocation schemes in clinical studies. The randomly reinforced urn was recently proposed, but, although the model has some intuitively desirable properties, it lacks theoretical justification. In this paper we obtain important asymptotic properties for multicolor reinforced urn models. We derive results for the rate of convergence of the number of patients assigned to each treatment under a set of minimum required conditions and provide the distributions of the limits. Furthermore, we study the asymptotic behavior for the nonhomogeneous case.
Asymptotic Gaussianity via coalescence probabilities in the Hammond-Sheffield urn

Jan Lukas Igelbrink,Anton Wakolbinger

DOI: https://doi.org/10.30757/ALEA.v20-04

2022-01-18

Abstract:For the renormalised sums of the random $\pm 1$-colouring of the connected components of $\mathbb Z$ generated by the coalescing renewal processes in the "power law P\'olya's urn" of Hammond and Sheffield we prove functional convergence towards fractional Brownian motion, closing a gap in the tightness argument of their paper. In addition, in the regime of the strong renewal theorem we gain insights into the coalescing renewal processes in the Hammond-Sheffield urn (such as the asymptotic depth of most recent common ancestors) and are able to control the coalescence probabilities of two, three and four individuals that are randomly sampled from $[n]$. This allows us to obtain a new, conceptual proof of the asymptotic Gaussianity (including the functional convergence) of the renormalised sums of more general colourings, which can be seen as an invariance principle beyond the main result of Hammond and Sheffield. In this proof, a key ingredient of independent interest is a sufficient criterion for the asymptotic Gaussianity of the renormalised sums in randomly coloured random partitions of $[n]$, based on Stein's method. Along the way we also prove a statement on the asymptotics of the coalescence probabilities in the long-range seedbank model of Blath, Gonz\'alez Casanova, Kurt, and Span\`o.

Probability
Almost sure and moment convergence for triangular Pólya urns

Svante Janson

2024-03-21

Abstract:We consider triangular Pólya urns and show under very weak conditions a general strong limit theorem of the form $X_{ni}/a_{ni}\to \mathcal{X}_i$ a.s., where $X_{ni}$ is the number of balls of colour $i$ after $n$ draws; the constants $a_{ni}$ are explicit and of the form $n^\alpha\log^\gamma n$; the limit is a.s. positive, and may be either deterministic or random, but is in general unknown.

Probability
Urns with Multiple Drawings and Graph-Based Interaction

Yogesh Dahiya,Neeraja Sahasrabudhe

DOI: https://doi.org/10.1007/s10959-024-01365-x

2024-08-28

Abstract:Consider a finite undirected graph and place an urn with balls of two colours at each vertex. At every discrete time step, for each urn, a fixed number of balls are drawn from that same urn with probability $p$, and from a randomly chosen neighbour of that urn with probability $1-p$. Based on what is drawn, the urns then reinforce themselves or their neighbours. For every ball of a given colour in the sample, in case of Pólya-type reinforcement, a constant multiple of balls of that colour is added while in case of Friedman-type reinforcement, balls of the other colour are reinforced. These different choices for reinforcement give rise to multiple models. In this paper, we study the convergence of the fraction of balls of either colour across urns for all of these models. We show that in most cases the urns synchronize, that is, the fraction of balls of either colour in each urn converges to the same limit almost surely. A different kind of asymptotic behaviour is observed on bipartite graphs. We also prove similar results for the case of finite directed graphs.

Probability
A Gaussian Process Approximation for Two-Color Randomly Reinforced Urns

Li-Xin Zhang

DOI: https://doi.org/10.1214/ejp.v19-3432

2014-01-01

Electronic Journal of Probability

Abstract:The Polya urn has been extensively studied and is widely applied in many disciplines. An important application is to use urn models to develop randomized treatment allocation schemes in clinical studies. As an extension of the Polya urn, the randomly reinforced urn was recently proposed to optimize clinical trials in the sense that patients are assigned to the best treatment with probability converging to one. In this paper, we prove a Gaussian process approximation for the sequence of random compositions of a two-color randomly reinforced urn for both the cases with the equal and unequal reinforcement means. By using the Gaussian approximation, the law of the iterated logarithm and the functional central limit theorem in both the stable convergence sense and the almost-sure conditional convergence sense are established. Also as a consequence, we are able to to prove that a random limit of the normalized urn composition has no point masses under the only assumption of finite (2 + epsilon)-th moments.
Infinite-color randomly reinforced urns with dominant colors

Hristo Sariev,Sandra Fortini,Sonia Petrone

DOI: https://doi.org/10.3150/21-BEJ1452

2023-12-12

Abstract:We define and prove limit results for a class of dominant Pólya sequences, which are randomly reinforced urn processes with color-specific random weights and unbounded number of possible colors. Under fairly mild assumptions on the expected reinforcement, we show that the predictive and the empirical distributions converge almost surely (a.s.) in total variation to the same random probability measure $\tilde{P}$; moreover, $\tilde{P}(\mathcal{D})=1$ a.s., where $\mathcal{D}$ denotes the set of dominant colors for which the expected reinforcement is maximum. In the general case, the predictive probabilities and the empirical frequencies of any $\delta$-neighborhood of $\mathcal{D}$ converge a.s. to one. That is, although non-dominant colors continue to be regularly observed, their distance to $\mathcal{D}$ converges in probability to zero. We refine the above results with rates of convergence. We further hint potential applications of dominant Pólya sequences in randomized clinical trials and species sampling, and use our central limit results for Bayesian inference.

Probability
Positive Reinforced Generalized Time-Dependent Pólya Urns via Stochastic Approximation

Wioletta M. Ruszel,Debleena Thacker

DOI: https://doi.org/10.1007/s10959-024-01366-w

2024-09-05

Journal of Theoretical Probability

Abstract:Consider a generalized time-dependent Pólya urn process defined as follows. Let be the number of urns/colors. At each time n , we distribute balls randomly to the d urns, proportionally to f , where f is a valid reinforcement function. We consider a general class of positive reinforcement functions assuming some monotonicity and growth condition. The class includes convex functions and the classical case , . The novelty of the paper lies in extending stochastic approximation techniques to the d -dimensional case and proving that eventually the process will fixate at some random urn and the other urns will not receive any balls anymore.

statistics & probability
On Pólya-Young urn models and growth processes

Markus Kuba

2024-06-27

Abstract:This work is devoted to Pólya-Young urns, a class of periodic Pólya urns of importance in the analysis of Young tableaux. We provide several extension of the previous results of Banderier, Marchal and Wallner [Ann. Prob. (2020)] on Pólya-Young urns and also generalize the previously studied model. We determine the limit law of the generalized model, involving the the local time of noise-reinforced Bessel processes. We also uncover a martingale structure, which leads directly to almost-sure convergence of the random variable of interest. This allows us to add second order asymptotics by providing a central limit theorem for the martingale tail sum, as well as a law of the iterated logarithm. We also turn to random vectors and obtain the limit law of Pólya-Young urns with multiple colors. Additionally, we introduce several growth processes and combinatorial objects, which are closely related to urn models. We define increasing trees with periodic immigration and we related the dynamics of the Pólya-Young urns to label-based parameters in such tree families. Furthermore, we discuss a generalization of Stirling permutations and obtain a bijection to increasing trees with periodic immigration. Finally, we introduce a chinese restaurant process with competition and relate it to increasing trees, as well as Pólya-Young urns.

Probability,Combinatorics
On affine multi-color urns grown under multiple drawing

Joshua Sparks,Markus Kuba,Srinivasan Balaji,Hosam Mahmoud

2024-03-19

Abstract:Early investigation of Pólya urns considered drawing balls one at a time. In the last two decades, several authors considered multiple drawing in each step, but mostly for schemes on two colors. In this manuscript, we consider multiple drawing from urns of balls of multiple colors, formulating asymptotic theory for specific urn classes and addressing more applications.

Probability
Multiple colour interacting urns on complete graphs

Benito Pires,Rafael A. Rosales

2024-09-17

Abstract:We present a multiple colour generalisation of the model of graph interacting urns studied by Benaim et. al., Random Struct. Alg., 46: 614-634, 2015. We show that for complete graphs and for a broad class of reinforcement functions governing the addition of balls in the urns, the process of colour proportions at each urn converges almost surely to the fixed points of the reinforcement function.

Probability
Convergence of randomized urn models with irreducible and reducible replacement policy

Li-Xin Zhang

DOI: https://doi.org/10.48550/arxiv.2204.04810

2022-01-01

Abstract: Generalized Friedman urn is one of the simplest and most useful models considered in probability theory. Since Athreya and Ney (1972) showed the almost sure convergence of urn proportions in a randomized urn model with irreducible replacement matrix under the $L\log L$ moment assumption, this assumption has been regarded as the weakest moment assumption, but the necessary has never been shown. In this paper, we study the strong and weak convergence of generalized Friedman urns. It is proved that, when the random replacement matrix is irreducible in probability, the sufficient and necessary moment assumption for the almost sure convergence of the urn proportions is that the expectation of the replacement matrix is finite, which is less stringent than the $L\log L$ moment assumption, and when the replacement is reducible, the $L\log L$ moment assumption is the weakest sufficient condition. The rate of convergence and the strong and weak convergence of non-homogenous generalized Friedman urns are also derived.
Complementary asymptotic analysis for a minimal random walk

Cristian F. Coletti,Manuel González-Navarrete,Víctor Hugo Vázquez Guevara

2024-04-26

Abstract:We discuss a complementary asymptotic analysis of the so called minimal random walk. More precisely, we present a version of the almost sure central limit theorem as well as a generalization of the recently proposed quadratic strong laws. In addition, alternative demonstrations of the functional limit theorems will be supplied based on a Pólya urn scheme instead of a martingale approach.

Probability
Gaussian Approximation Theorems for Urn Models and Their Applications

ZD Bai,FF Hu,LX Zhang

DOI: https://doi.org/10.1214/aoap/1037125857

2002-01-01

Abstract:We consider weak and strong Gaussian approximations for a two-color generalized Friedman's urn model with homogeneous and nonhomogeneous generating matrices. In particular, the functional central limit theorems and the laws of iterated logarithm are obtained. As an application, we obtain the asymptotic properties for the randomized-play-the-winner rule. Based on the Gaussian approximations, we also get some variance estimators for the urn model.
Interacting urn models with strong reinforcement

Shuo Qin

2024-10-05

Abstract:For the interacting urn model with polynomial reinforcement, it has been conjectured that almost surely one color monopolizes all the urns if the interaction parameter $p>0$. We disprove the conjecture. For the case $p=1$, we give a sufficient condition for monopoly, which improves a previous result obtained by Launay.

Probability,Dynamical Systems
Large deviation inequalities for the nonlinear unbalanced urn model

Jianan Shi,Zhenhong Yu,Yu Miao

2024-09-12

Abstract:In the present paper, we consider the two-color nonlinear unbalanced urn model, under a drawing rule reinforced by an $\mathbb{R}^+$-valued concave function and an unbalanced replacement matrix. The large deviation inequalities for the nonlinear unbalanced urn model are established by using the stochastic approximation theory. As an auxiliary theory, we give a specific large deviation inequality for a general stochastic approximation algorithm.

Probability
Pólya urns on hypergraphs

Pedro Alves,Matheus Barros,Yuri Lima

2023-09-30

Abstract:We study Pólya urns on hypergraphs and prove that, when the incidence matrix of the hypergraph is injective, there exists a point $v=v(H)$ such that the random process converges to $v$ almost surely. We also provide a partial result when the incidence matrix is not injective.

Dynamical Systems,Combinatorics,Probability
A martingale approach for Pólya urn processes

Lucile Laulin

DOI: https://doi.org/10.48550/arXiv.2003.04592

2020-03-10

Probability

Abstract:This paper is devoted to a direct martingale approach for P{\'o}lya urn models asymptotic behaviour. A P{\'o}lya process is said to be small when the ratio of its remplacement matrix eigenvalues is less than or equal to 1/2, otherwise it is called large. We find again some well-known results on the asymptotic behaviour for small and large urns processes. We also provide new almost sure properties for small urns processes.
Cutoff in the Bernoulli-Laplace Model With Unequal Colors and Urn Sizes

Thomas Griffin,Bailey Hall,Jackson Hebner,David Herzog,Denis Selyuzhitsky,Kevin Wong,John Wright

2023-08-17

Abstract:We consider a generalization of the Bernoulli-Laplace model in which there are two urns and $n$ total balls, of which $r$ are red and $n - r$ white, and where the left urn holds $m$ balls. At each time increment, $k$ balls are chosen uniformly at random from each urn and then swapped. This system can be used to model phenomena such as gas particle interchange between containers or card shuffling. Under a reasonable set of assumptions, we bound the mixing time of the resulting Markov chain asymptotically in $n$ with cutoff at $\log{n}$ and constant window. Among other techniques, we employ the spectral analysis of <a class="link-https" data-arxiv-id="0906.4242" href="https://arxiv.org/abs/0906.4242">arXiv:0906.4242</a> on the Markov transition kernel and the chain coupling tools of <a class="link-https" data-arxiv-id="2203.08647" href="https://arxiv.org/abs/2203.08647">arXiv:2203.08647</a> and <a class="link-https" data-arxiv-id="1606.01437" href="https://arxiv.org/abs/1606.01437">arXiv:1606.01437</a>.

Probability,Combinatorics
Quantitative Russo-Seymour-Welsh for random walk on random graphs and decorrelation of UST

Gourab Ray,Tingzhou Yu

DOI: https://doi.org/10.48550/arXiv.2106.10323

2021-06-19

Abstract:We prove a quantitative Russo-Seymour-Welsh (RSW) type result for random walks on two natural examples of random planar graphs: the supercritical percolation cluster in the square lattice and the Poisson Voronoi triangulation in the plane. More precisely, we prove that the probability that a simple random walk crosses a rectangle in the hard direction with uniformly positive probability is stretched exponentially likely in the size of the rectangle. As an application we prove a near optimal decorrelation result for uniform spanning trees for such graphs. This is the key missing step in this setup while applying of the proof stretegy of a previous article on universality of dimers ("Dimers and imaginary geometry." Ann. Probab. 48 (1) 1 - 52) where random walk RSW was assumed to hold with probability 1. Applications to almost sure Gaussian free field scaling limit for dimers on Temperleyan type modification on such graphs are also discussed.

Probability

A.S. convergence for infinite colour Pólya urns associated with stable random walks

Asymptotic Properties of Multicolor Randomly Reinforced Pólya Urns

Asymptotic Gaussianity via coalescence probabilities in the Hammond-Sheffield urn

Almost sure and moment convergence for triangular Pólya urns

Urns with Multiple Drawings and Graph-Based Interaction

A Gaussian Process Approximation for Two-Color Randomly Reinforced Urns

Infinite-color randomly reinforced urns with dominant colors

Positive Reinforced Generalized Time-Dependent Pólya Urns via Stochastic Approximation

On Pólya-Young urn models and growth processes

On affine multi-color urns grown under multiple drawing

Multiple colour interacting urns on complete graphs

Convergence of randomized urn models with irreducible and reducible replacement policy

Complementary asymptotic analysis for a minimal random walk

Gaussian Approximation Theorems for Urn Models and Their Applications

Interacting urn models with strong reinforcement

Large deviation inequalities for the nonlinear unbalanced urn model

Pólya urns on hypergraphs

A martingale approach for Pólya urn processes

Cutoff in the Bernoulli-Laplace Model With Unequal Colors and Urn Sizes

Quantitative Russo-Seymour-Welsh for random walk on random graphs and decorrelation of UST