Record indices and age-ordered frequencies in Gibbs random partitions

Robert C. Griffiths,Dario Spanó

DOI: https://doi.org/10.48550/arXiv.math/0701897

2007-07-09

Abstract:The distribution of age-ordered frequencies arising from an exchangeable Gibbs partition is studied in relation with the distribution of the positions at which new mutations appear in a sample.

Probability,Statistics Theory

What problem does this paper attempt to address?

Ordered and size-biased frequencies in GEM and Gibbs models for species sampling

Jim Pitman,Yuri Yakubovich

DOI: https://doi.org/10.48550/arXiv.1704.04732

2017-08-26

Abstract:We describe the distribution of frequencies ordered by sample values in a random sample of size $n$ from the two parameter GEM$(\alpha,\theta)$ random discrete distribution on the positive integers. These frequencies are a $($size$-\alpha)$-biased random permutation of the sample frequencies in either ranked order, or in the order of appearance of values in the sampling process. This generalizes a well known identity in distribution due to Donnelly and Tavaré (1986) for $\alpha = 0$ to the case $0 \le \alpha < 1$. This description extends to sampling from Gibbs$(\alpha)$ frequencies obtained by suitable conditioning of the GEM$(\alpha,\theta)$ model, and yields a value-ordered version of the Chinese Restaurant construction of GEM$(\alpha,\theta)$ and Gibbs$(\alpha)$ frequencies in the more usual size-biased order of their appearance. The proofs are based on a general construction of a finite sample $(X_1,\dots,X_n)$ from any random frequencies in size-biased order from the associated exchangeable random partition $\Pi_\infty$ of $\mathbb{N}$ which they generate.

Probability
Coherent random permutations with record statistics

Alexander Gnedin

DOI: https://doi.org/10.48550/arXiv.math/0611538

2006-11-18

Abstract:Random permutations with distribution conditionally uniform given the set of record values can be generated in a unified way, coherently for all values of $n$. Our central example is a two-parameter family of random permutations that are conditionally uniform given the counts of upper and lower records. This family interpolates between two versions of Ewens' distribution. We discuss characterisations of the conditionally uniform permutations, their asymptotic properties, constructions and relations to random partitions.

Probability,Combinatorics
Record statistics for random walk bridges

Claude Godrèche,Satya N Majumdar,Grégory Schehr

DOI: https://doi.org/10.1088/1742-5468/2015/07/p07026

2015-07-30

Abstract:We investigate the statistics of records in a random sequence of n time steps. The sequence ’s represents the position at step k of a random walk ‘bridge’ of n steps that starts and ends at the origin. At each step, the increment of the position is a random jump drawn from a specified symmetric distribution. We study the statistics of records and record ages for such a bridge sequence, for different jump distributions. In absence of the bridge condition, i.e. for a free random walk sequence, the statistics of the number and ages of records exhibits a ‘strong’ universality for all n, i.e. they are completely independent of the jump distribution as long as the distribution is continuous. We show that the presence of the bridge constraint destroys this strong ‘all n’ universality. Nevertheless a ‘weaker’ universality still remains for large n, where we show that the record statistics depends on the jump distributions only through a single parameter , known as the Lévy index of the walk, but are insensitive to the other details of the jump distribution. We derive the most general results (for arbitrary jump distributions) wherever possible and also present two exactly solvable cases. We present numerical simulations that verify our analytical results.
Generalized Chinese restaurant construction of exchangeable Gibbs partitions and related results

Annalisa Cerquetti

DOI: https://doi.org/10.48550/arXiv.0805.3853

2008-05-26

Abstract:By resorting to sequential constructions of exchangeable random partitions (Pitman, 2006), and exploiting some known facts about generalized Stirling numbers, we derive a generalized Chinese restaurant process construction of exchangeable Gibbs partitions of type $\alpha$ (Gnedin and Pitman, 2006). Our construction represents the natural theoretical probabilistic framework in which to embed some recent results about a Bayesian nonparametric treatment of estimation problems arising in genetic experiment under Gibbs, species sampling, models priors.

Probability
Branching Interval Partition Diffusions

Matthew Buckland

2024-02-13

Abstract:We introduce and study branching interval partition diffusions in their natural generality. We let interval widths evolve independently according to a general real-valued diffusion subject only to conditions that ensure finite lifetimes of intervals and allow the continuous generation of new intervals. The latter is governed by the Pitman-Yor excursion measure of the real-valued diffusion and an associated spectrally positive Lévy process to order both these excursions and their start times. This generalises previous work by Forman, Pal, Rizzolo and Winkel on the self-similar case and gives rise to a new class of general Markovian homogeneous Crump-Mode-Jagers-type branching processes with characteristics varying diffusively during their lifetimes.

Probability
Growing integer partitions with uniform marginals and the equivalence of partition ensembles

Yuri Yakubovich

DOI: https://doi.org/10.1016/j.aim.2024.109908

2024-09-28

Abstract:We present an explicit construction of a Markovian random growth process on integer partitions such that given it visits some level $n$, it passes through any partition $\lambda$ of $n$ with equal probabilities. The construction has continuous time, but we also investigate its discrete time jump chain. The jump probabilities are given by explicit but complicated expressions, so we find their asymptotic behavior as the partition becomes large. This allows us to explain how the limit shape is formed. Using the known connection of the considered probabilistic objects to Poisson point processes, we give an alternative description of the partition growth process in these terms. Then we apply the constructed growth process to find sufficient conditions for a phenomenon known as equivalence of two ensembles of random partitions for a finite number of partition characteristics. This result allows to show that counts of odd and even parts in a random partition of $n$ are asymptotically independent as $n\to\infty$ and to find their limiting distributions, which are, somewhat surprisingly, different.

Probability
Formal properties of the probability of fixation: identities, inequalities and approximations

David M. McCandlish,Charles L. Epstein,Joshua B. Plotkin

DOI: https://doi.org/10.1016/j.tpb.2014.11.004

2014-04-11

Abstract:The formula for the probability of fixation of a new mutation is widely used in theoretical population genetics and molecular evolution. Here we derive a series of identities, inequalities and approximations for the exact probability of fixation of a new mutation under the Moran process (equivalent results hold for the approximate probability of fixation for the Wright-Fisher process after an appropriate change of variables). We show that the behavior of the logarithm of the probability of fixation is particularly simple when the selection coefficient is measured as a difference of Malthusian fitnesses, and we exploit this simplicity to derive several inequalities and approximations. We also present a comprehensive comparison of both existing and new approximations for the probability of fixation, highlighting in particular approximations that result in a reversible Markov chain when used to model the dynamics of evolution under weak mutation.

Populations and Evolution
Exponential ergodicity of a degenerate age-size piecewise deterministic process

Ignacio Madrid

DOI: https://doi.org/10.1007/s10440-023-00597-z

2024-03-19

Abstract:We study the long-time behaviour of the first-moment semigroup of a non conservative piecewise deterministic measure-valued stochastic process with support on R 2 + driven by a deterministic flow between random jump times, with a transition kernel which has a degenerate form. Using a Doob h-transform where the function h is taken as an eigenfunction of the associated generator, we can bring ourselves back to the study of a conservative process whose exponential ergodicity is proven via Harris' Theorem. Particular attention is given to the proof of Doeblin minoration condition. The main difficulty is the degeneracy of one of the two variables, and the deterministic dependency between the two variables, which make it no trivial to uniformly bound the expected value of the trajectories with respect to a non-degenerate measure in a two-dimensional space, which is particularly hard in a non-compact setting. Here, we propose a general method to construct explicit trajectories which explore the space state with positive probability and witch permit to prove a petite-set condition for the compact sets of the state space. An application to an age-structured growthfragmentation process modelling bacterial growth is also shown.

Analysis of PDEs,Probability
Record Ages of Scale Invariant non-Markovian Random Walks

Léo Régnier,Maxim Dolgushev,Olivier Bénichou

DOI: https://doi.org/10.1038/s41467-023-41945-9

2023-10-13

Abstract:How long is needed for an observable to exceed its previous highest value and establish a new record? This time, known as the age of a record plays a crucial role in quantifying record statistics. Until now, general methods for determining record age statistics have been limited to observations of either independent random variables or successive positions of a Markovian (memoryless) random walk. Here we develop a theoretical framework to determine record age statistics in the presence of memory effects for continuous non-smooth processes that are asymptotically scale-invariant. Our theoretical predictions are confirmed by numerical simulations and experimental realizations of diverse representative non-Markovian random walk models and real time series with memory effects, in fields as diverse as genomics, climatology, hydrology, geology and computer science. Our results reveal the crucial role of the number of records already achieved in time series and change our view on analysing record statistics.

Statistical Mechanics,Mathematical Physics
Random optimization problems at fixed temperatures

Partha S. Dey,Grigory Terlov

2024-02-13

Abstract:This article considers a class of disordered mean-field combinatorial optimization problems. We focus on the Gibbs measure, where the inverse temperature does not vary with the size of the graph and the edge weights are sampled from a general distribution under mild assumptions. Our results consist of the Law of Large Numbers and Central Limit Theorems for the log-partition function, the weight of a typical configuration, and the Gibbs average in both quenched and annealed forms. We also derive quenched Poisson convergence for the size of the intersection of two independent samples, yielding replica symmetry of the model. Applications cover popular models from the literature, such as the Minimal Matching Problem, Traveling Salesman Problem, and Minimal Spanning Tree Problem, on a sequence of deterministic and random dense block graphs of increasing size.

Probability,Combinatorics
The Griffiths phase and beyond: A large deviations study of the magnetic susceptibility of the two-dimensional bond-diluted Ising model

Lambert Münster,Alexander K. Hartmann,Martin Weigel

2024-05-05

Abstract:The Griffiths phase in systems with quenched disorder occurs below the ordering transition of the pure system down to the ordering transition of the actual disordered system. While it does not exhibit long-range order, large fluctuations in the disorder degrees of freedom result in exponentially rare, long-range ordered states and hence the occurrence of broad distributions in response functions. Inside the Griffiths phase of the two-dimensional bond-diluted Ising model the distribution of the magnetic susceptibility is expected to have such a broad, exponential tail. A large-deviations Monte Carlo algorithm is used to sample this distribution and the exponential tail is extracted over a wide range of the support down to very small probabilities of the order of $10^{-300}$. We study the behavior of the susceptibility distribution across the full phase diagram, from the paramagnetic state through the Griffiths phase to the ferromagnetically ordered system and down to the zero-temperature point. We extract the rate function of large-deviation theory as well as its finite-size scaling behavior and we reveal interesting differences and similarities between the cases. A connection between the fraction of ferromagnetic bonds in a given disorder sample and the size of the magnetic susceptibility is demonstrated numerically.

Disordered Systems and Neural Networks,Statistical Mechanics,Computational Physics
Approximations of the allelic frequency spectrum in general supercritical branching populations

Benoit Henry

DOI: https://doi.org/10.48550/arXiv.1701.07281

2017-01-25

Abstract:We consider a general branching population where the lifetimes of individuals are i.i.d.\ with arbitrary distribution and where each individual gives birth to new individuals at Poisson times independently from each other. In addition, we suppose that individuals experience mutations at Poissonian rate $\theta$ under the infinitely many alleles assumption assuming that types are transmitted from parents to offspring. This mechanism leads to a partition of the population by type, called the allelic partition. The main object of this work is the frequency spectrum $A(k,t)$ which counts the number of families of size $k$ in the population at time $t$. The process $(A(k,t),\ t\in\mathbb{R}_+)$ is an example of non-Markovian branching process belonging to the class of general branching processes counted by random characteristics. In this work, we propose methods of approximation to replace the frequency spectrum by simpler quantities. Our main goal is study the asymptotic error made during these approximations through central limit theorems. In a last section, we perform several numerical analysis using this model, in particular to analyze the behavior of one of these approximations with respect to Sabeti's Extended Haplotype Homozygosity [18].

Probability,Populations and Evolution
Record statistics of integrated random walks and the random acceleration process

Claude Godrèche,Jean-Marc Luck

DOI: https://doi.org/10.1007/s10955-021-02852-9

2021-09-13

Abstract:We address the theory of records for integrated random walks with finite variance. The long-time continuum limit of these walks is a non-Markov process known as the random acceleration process or the integral of Brownian motion. In this limit, the renewal structure of the record process is the cornerstone for the analysis of its statistics. We thus obtain the analytical expressions of several characteristics of the process, notably the distribution of the total duration of record runs (sequences of consecutive records), which is the continuum analogue of the number of records of the integrated random walks. This result is universal, i.e., independent of the details of the parent distribution of the step lengths.

Statistical Mechanics,Probability
An informational transition in conditioned Markov chains: Applied to genetics and evolution.

Lei Zhao,Martin Lascoux,David Waxman

DOI: https://doi.org/10.1016/j.jtbi.2016.04.021

IF: 2.405

2016-01-01

Journal of Theoretical Biology

Abstract:In this work we assume that we have some knowledge about the state of a population at two known times, when the dynamics is governed by a Markov chain such as a Wright-Fisher model. Such knowledge could be obtained, for example, from observations made on ancient and contemporary DNA, or during laboratory experiments involving long term evolution. A natural assumption is that the behaviour of the population, between observations, is related to (or constrained by) what was actually observed. The present work shows that this assumption has limited validity. When the time interval between observations is larger than a characteristic value, which is a property of the population under consideration, there is a range of intermediate times where the behaviour of the population has reduced or no dependence on what was observed and an equilibrium-like distribution applies. Thus, for example, if the frequency of an allele is observed at two different times, then for a large enough time interval between observations, the population has reduced or no dependence on the two observed frequencies for a range of intermediate times. Given observations of a population at two times, we provide a general theoretical analysis of the behaviour of the population at all intermediate times, and determine an expression for the characteristic time interval, beyond which the observations do not constrain the population's behaviour over a range of intermediate times. The findings of this work relate to what can be meaningfully inferred about a population at intermediate times, given knowledge of terminal states.
Mixing of fast random walks on dynamic random permutations

Luca Avena,Remco van der Hofstad,Frank den Hollander,Oliver Nagy

2024-03-01

Abstract:We analyse the mixing profile of a random walk on a dynamic random permutation, focusing on the regime where the walk evolves much faster than the permutation. Two types of dynamics generated by random transpositions are considered: one allows for coagulation of permutation cycles only, the other allows for both coagulation and fragmentation. We show that for both types, after scaling time by the length of the permutation and letting this length tend to infinity, the total variation distance between the current distribution and the uniform distribution converges to a limit process that drops down in a single jump. This jump is similar to a one-sided cut-off, occurs after a random time whose law we identify, and goes from the value 1 to a value that is a strictly decreasing and deterministic function of the time of the jump, related to the size of the largest component in Erdős-Rényi random graphs. After the jump, the total variation distance follows this function down to 0.

Probability
Limit theorems for the site frequency spectrum of neutral mutations in an exponentially growing population

Einar Bjarki Gunnarsson,Kevin Leder,Xuanming Zhang

2024-03-13

Abstract:The site frequency spectrum (SFS) is a widely used summary statistic of genomic data. Motivated by recent evidence for the role of neutral evolution in cancer, we investigate the SFS of neutral mutations in an exponentially growing population. Using branching process techniques, we establish (first-order) almost sure convergence results for the SFS of a Galton-Watson process, evaluated either at a fixed time or at the stochastic time at which the population first reaches a certain size. We finally use our results to construct consistent estimators for the extinction probability and the effective mutation rate of a birth-death process.

Probability,Populations and Evolution
Population splitting, trapping, and non-ergodicity in heterogeneous diffusion processes

Andrey G. Cherstvy,Ralf Metzler

DOI: https://doi.org/10.48550/arXiv.1307.6407

2013-07-24

Statistical Mechanics

Abstract:We consider diffusion processes with a spatially varying diffusivity giving rise to anomalous diffusion. Such heterogeneous diffusion processes are analysed for the cases of exponential, power-law, and logarithmic dependencies of the diffusion coefficient on the particle position. Combining analytical approaches with stochastic simulations, we show that the functional form of the space-dependent diffusion coefficient and the initial conditions of the diffusing particles are vital for their statistical and ergodic properties. In all three cases a weak ergodicity breaking between the time and ensemble averaged mean squared displacements is observed. We also demonstrate a population splitting of the time averaged traces into fast and slow diffusers for the case of exponential variation of the diffusivity as well as a particle trapping in the case of the logarithmic diffusivity. Our analysis is complemented by the quantitative study of the space coverage, the diffusive spreading of the probability density, as well as the survival probability.
Asymptotics for the site frequency spectrum associated with the genealogy of a birth and death process

Jason Schweinsberg,Yubo Shuai

2023-04-27

Abstract:Consider a birth and death process started from one individual in which each individual gives birth at rate $\lambda$ and dies at rate $\mu$, so that the population size grows at rate $r = \lambda - \mu$. Lambert and Harris, Johnston, and Roberts came up with methods for constructing the exact genealogy of a sample of size $n$ taken from this population at time $T$. We use the construction of Lambert, which is based on the coalescent point process, to obtain asymptotic results for the site frequency spectrum associated with this sample. In the supercritical case $r > 0$, our results extend results of Durrett for exponentially growing populations. In the critical case $r = 0$, our results parallel those that Dahmer and Kersting obtained for Kingman's coalescent.

Probability,Populations and Evolution
From clonal interference to Poissonian interacting trajectories

Felix Hermann,Adrián Gonzalez Casanova,Renato Soares dos Santos,András Tóbiás,Anton Wakolbinger

2024-11-01

Abstract:We consider a population whose size $N$ is fixed over the generations, and in which random beneficial mutations arrive at a rate of order $1/\log N$ per generation. In this so-called Gerrish-Lenski regime, typically a finite number of contending mutations is present together with one resident type. These mutations compete for fixation, a phenomenon addressed as clonal interference. We study a system of Poissonian interacting trajectories (PIT) which arise as a large population scaling limit of the logarithmic sizes of the contending clonal subpopulations. We prove that this system exhibits an a.s.\ positive asymptotic rate of fitness increase (speed of adaptation), which turns out to be finite if and only if fitness increments have a finite expectation. We relate this speed to heuristic predictions from the literature. Furthermore, we derive a functional central limit theorem for the fitness of the resident population in the PIT. A main result of this work is that the Poissonian interacting trajectories arise as a large-population limit of a continuous time Moran model with strong selection.

Probability
Limiting partition function for the Mallows model: a conjecture and partial evidence

Soumik Pal

2024-06-27

Abstract:Let $S_n$ denote the set of permutations of $n$ labels. We consider a class of Gibbs probability models on $S_n$ that is a subfamily of the so-called Mallows model of random permutations. The Gibbs energy is given by a class of right invariant divergences on $S_n$ that includes common choices such as the Spearman foot rule and the Spearman rank correlation. Mukherjee in 2016 computed the limit of the (scaled) log partition function (i.e. normalizing factor) of such models as $n\rightarrow \infty$. Our objective is to compute the exact limit, as $n\rightarrow \infty$, without the log. We conjecture that this limit is given by the Fredholm determinant of an integral operator related to the so-called Schrödinger bridge probability distributions from optimal transport theory. We provide partial evidence for this conjecture, although the argument lacks a final error bound that is needed for it to become a complete proof.

Probability

Record indices and age-ordered frequencies in Gibbs random partitions

Ordered and size-biased frequencies in GEM and Gibbs models for species sampling

Coherent random permutations with record statistics

Record statistics for random walk bridges

Generalized Chinese restaurant construction of exchangeable Gibbs partitions and related results

Branching Interval Partition Diffusions

Growing integer partitions with uniform marginals and the equivalence of partition ensembles

Formal properties of the probability of fixation: identities, inequalities and approximations

Exponential ergodicity of a degenerate age-size piecewise deterministic process

Record Ages of Scale Invariant non-Markovian Random Walks

Random optimization problems at fixed temperatures

The Griffiths phase and beyond: A large deviations study of the magnetic susceptibility of the two-dimensional bond-diluted Ising model

Approximations of the allelic frequency spectrum in general supercritical branching populations

Record statistics of integrated random walks and the random acceleration process

An informational transition in conditioned Markov chains: Applied to genetics and evolution.

Mixing of fast random walks on dynamic random permutations

Limit theorems for the site frequency spectrum of neutral mutations in an exponentially growing population

Population splitting, trapping, and non-ergodicity in heterogeneous diffusion processes

Asymptotics for the site frequency spectrum associated with the genealogy of a birth and death process

From clonal interference to Poissonian interacting trajectories

Limiting partition function for the Mallows model: a conjecture and partial evidence