A boundary theory approach to de Finetti's theorem

Julian Gerstenberg,Rudolf Grübel,Klaas Hagemann

DOI: https://doi.org/10.48550/arXiv.1610.02561

2016-10-09

Abstract:We show that boundary theory for transient Markov chains, as initiated by Doob, can be used to prove de Finetti's classical representation result for exchangeable random sequences. We also include the relevant parts of the theory, with full proofs.

Probability

What problem does this paper attempt to address?

Proof of the Diaconis--Freedman Conjecture on partially-exchangeable processes

Noah Halberstam,Tom Hutchcroft

2024-05-31

Abstract:We prove a conjecture of Diaconis and Freedman (Ann. Probab. 1980) characterising the extreme points of the set of partially-exchangeable processes on a countable set. More concretely, we prove that the partially exchangeable sigma-algebra of any transient partially exchangeable process $X=(X_i)_{i\geq 0}$ (and hence any transient Markov chain) coincides up to null sets with the sigma-algebra generated by the initial state $X_0$ and the transition counts $( \#\{i\geq 0: X_i=x, X_{i+1}=y\} : x,y\in S)$. Our proof is based on an analysis of Gibbs measures for Eulerian paths on rooted digraphs, relying in particular on the connection to uniform spanning trees and Wilson's algorithm via the de Bruijn--Ehrenfest--Smith--Tutte (BEST) bijection, and yields an explicit method to sample from the conditional distribution of a transient Markov chain given its transition counts.

Probability
Generalizing the de Finetti--Hewitt--Savage theorem

Irfan Alam

2023-06-21

Abstract:A sequence of random variables is called exchangeable if its joint distribution is invariant under permutations. The original formulation of de Finetti's theorem says that any exchangeable sequence of $\{0,1\}$-valued random variables can be thought of as a mixture of independent and identically distributed sequences in a certain precise mathematical sense. Interpreting this statement from a convex analytic perspective, Hewitt and Savage obtained the same conclusion for more general state spaces under some topological conditions. The main contribution of this paper is in providing a new framework that explains the theorem purely as a consequence of the underlying distribution of the random variables, with no topological conditions (beyond Hausdorffness) on the state space being necessary if the distribution is Radon. We also show that it is consistent with the axioms of ZFC that de Finetti's theorem holds for all sequences of exchangeable random variables taking values in any complete metric space. The framework we use is based on nonstandard analysis. We have provided a self-contained introduction to nonstandard analysis as an appendix, thus rendering measure theoretic probability and point-set topology as the only prerequisites for this paper. Our introduction aims to develop some new ideologies that might be of interest to mathematicians, philosophers, and mathematics educators alike. Our technical tools come from nonstandard topological measure theory, in which a highlight is a new generalization of Prokhorov's theorem. Modulo such technical tools, our proof relies on properties of the empirical measures induced by hyperfinitely many identically distributed random variables -- a feature that allows us to establish de Finetti's theorem in the generality that we seek while still retaining the combinatorial intuition of proofs of simpler versions of de Finetti's theorem.

Probability,Logic,Statistics Theory
De Finetti's theorem and related results for infinite weighted exchangeable sequences

Rina Foygel Barber,Emmanuel J. Candes,Aaditya Ramdas,Ryan J. Tibshirani

2023-11-28

Abstract:De Finetti's theorem, also called the de Finetti-Hewitt-Savage theorem, is a foundational result in probability and statistics. Roughly, it says that an infinite sequence of exchangeable random variables can always be written as a mixture of independent and identically distributed (i.i.d.) sequences of random variables. In this paper, we consider a weighted generalization of exchangeability that allows for weight functions to modify the individual distributions of the random variables along the sequence, provided that -- modulo these weight functions -- there is still some common exchangeable base measure. We study conditions under which a de Finetti-type representation exists for weighted exchangeable sequences, as a mixture of distributions which satisfy a weighted form of the i.i.d. property. Our approach establishes a nested family of conditions that lead to weighted extensions of other well-known related results as well, in particular, extensions of the zero-one law and the law of large numbers.

Statistics Theory,Probability
Connecting classical finite exchangeability to quantum theory

Alessio Benavoli,Alessandro Facchini,Marco Zaffalon

2023-06-07

Abstract:Exchangeability is a fundamental concept in probability theory and statistics. It allows to model situations where the order of observations does not matter. The classical de Finetti's theorem provides a representation of infinitely exchangeable sequences of random variables as mixtures of independent and identically distributed variables. The quantum de Finetti theorem extends this result to symmetric quantum states on tensor product Hilbert spaces. However, both theorems do not hold for finitely exchangeable sequences. The aim of this work is to investigate two lesser-known representation theorems. Developed in classical probability theory, they extend de Finetti's theorem to finitely exchangeable sequences by using quasi-probabilities and quasi-expectations. With the aid of these theorems, we illustrate how a de Finetti-like representation theorem for finitely exchangeable sequences requires a mathematical representation which is formally equivalent to quantum theory (with boson-symmetric density matrices).

Quantum Physics,Probability
On a boundary of the central limit theorem for strictly stationary, reversible Markov chains

Richard C. Bradley

2024-11-06

Abstract:Consider the class of (functions of) strictly stationary Markov chains in which (i) the second moments are finite and (ii) absolute regularity (beta-mixing) is satisfied with exponential mixing rate. For (functions of) Markov chains in that class that are also reversible, the central limit theorem holds, as a well known byproduct of results of Roberts, Rosenthal, and Tweedie in two papers in 1997 and 2001 involving reversible Markov chains. In contrast, for (functions of) Markov chains in that class that are not reversible, the central limit theorem may fail to hold, as is known from counterexamples, including ones with arbitrarily fast mixing rate (for absolute regularity). Here it will be shown that for Markov chains in that class that are reversible, the``borderline'' class of mixing rates (for absolute regularity) for the central limit theorem is in fact exponential. That will be shown here with a class of counterexamples: strictly stationary, countable-state Markov chains that are reversible, have finite second moments, and satisfy absolute regularity with mixing rates that can be arbitrarily close to (but not quite) exponential, but fail to satisfy the central limit theorem.

Probability
Variations on quantum de Finetti theorems and operator valued Martin boundaries: a Choquet-Deny approach

Benoît Collins,Thierry Giordano,Ryosuke Sato

2024-02-15

Abstract:We revisit the quantum de Finetti theorem. We state and prove a couple of variants thereof. In parallel, we introduce an operator version of the Martin boundary on quantum groups and prove generalizations of Biane's theoresm. Our proof of the de Finetti theorem is new in the sense that it is based on an analogy with the theory of operator valued Martin boundary that we introduce.

Operator Algebras,Mathematical Physics
Boundary trace theorems for symmetric reflected diffusions

Shiping Cao,Zhen-Qing Chen

2024-10-25

Abstract:Starting with a transient irreducible diffusion process $X^0$ on a locally compact separable metric space $(D, d)$, one can construct a canonical symmetric reflected diffusion process $\bar X$ on a completion $D^*$ of $(D, d)$ through the theory of reflected Dirichlet spaces. The boundary trace process $\check X$ of $X$ on the boundary $\partial D:=D^*\setminus D$ is the reflected diffusion process $\bar X$ time-changed by a smooth measure $\nu$ having full quasi-support on $\partial D$. The Dirichlet form of the trace process $\check X$ is called the trace Dirichlet form. In the first part of the paper, we give a Besov space type characterization of the domain of the trace Dirichlet form for any good smooth measure $\nu$ on the boundary $\partial D$. In the second part of this paper, we study properties of the harmonic measure of $\bar X$ on the boundary $\partial D$. In particular, we provide a condition equivalent to the doubling property of the harmonic measure. Finally, we characterize and provide estimates of the jump kernel of the trace Dirichlet form under the doubling condition of the harmonic measure on $\partial D$.

Probability
Coag-Frag duality for a class of stable Poisson-Kingman mixtures

Lancelot F. James

DOI: https://doi.org/10.48550/arXiv.1008.2420

2010-08-14

Abstract:Exchangeable sequences of random probability measures (partitions of mass) and their corresponding exchangeable bridges play an important role in a variety of areas in probability, statistics and related areas, including Bayesian statistics, physics, finance and machine learning. An area of theoretical as well as practical interest, is the study of coagulation and fragmentation operators on partitions of mass. In this regard, an interesting but formidable question is the identification of operators and distributional families on mass partitions that exhibit interesting duality relations. In this paper we identify duality relations for a large sub-class of mixed Poisson-Kingman models generated by a stable subordinator. Our results are natural generalizations of the duality relations developed in Pitman, Bertoin and Goldschmidt, and Dong, Goldschmidt and Martin for the two-parameter Poisson Dirichlet family. These results are deduced from results for corresponding bridges.

Probability
Finite and infinite weighted exchangeable sequences

Wenpin Tang

DOI: https://doi.org/10.48550/arXiv.2306.11584

2023-06-20

Statistics Theory

Abstract:Motivated by recent interests in predictive inference under distribution shift, we study the problem of approximating finite weighted exchangeable sequences by a mixture of finite sequences with independent terms. Various bounds are derived in terms of weight functions, extending previous results on finite exchangeable sequences. As a byproduct, we obtain a version of de Finetti's theorem for infinite weighted exchangeable sequences.
A de Finetti theorem for quantum causal structures

Fabio Costa,Jonathan Barrett,Sally Shrapnel

2024-04-24

Abstract:What does it mean for a causal structure to be `unknown'? Can we even talk about `repetitions' of an experiment without prior knowledge of causal relations? And under what conditions can we say that a set of processes with arbitrary, possibly indefinite, causal structure are independent and identically distributed? Similar questions for classical probabilities, quantum states, and quantum channels are beautifully answered by so-called "de Finetti theorems", which connect a simple and easy-to-justify condition -- symmetry under exchange -- with a very particular multipartite structure: a mixture of identical states/channels. Here we extend the result to processes with arbitrary causal structure, including indefinite causal order and multi-time, non-Markovian processes applicable to noisy quantum devices. The result also implies a new class of de Finetti theorems for quantum states subject to a large class of linear constraints, which can be of independent interest.

Quantum Physics
Finite de Finetti bounds in relative entropy

Lampros Gavalakis,Oliver Johnson,Ioannis Kontoyiannis

2024-07-18

Abstract:We review old and recent finite de Finetti theorems in total variation distance and in relative entropy, and we highlight their connections with bounds on the difference between sampling with and without replacement. We also establish two new finite de Finetti theorems for exchangeable random vectors taking values in arbitrary spaces. These bounds are tight, and they are independent of the size and the dimension of the underlying space.

Probability,Information Theory
A Third Information-Theoretic Approach to Finite de Finetti Theorems

Mario Berta,Lampros Gavalakis,Ioannis Kontoyiannis

2024-04-26

Abstract:A new finite form of de Finetti's representation theorem is established using elementary information-theoretic tools. The distribution of the first $k$ random variables in an exchangeable vector of $n\geq k$ random variables is close to a mixture of product distributions. Closeness is measured in terms of the relative entropy and an explicit bound is provided. This bound is tighter than those obtained via earlier information-theoretic proofs, and its utility extends to random variables taking values in general spaces. The core argument employed has its origins in the quantum information-theoretic literature.

Information Theory,Probability,Quantum Physics
A Class of Strong Deviation Theorems for the Random Fields Associated with Nonhomogeneous Markov Chains Indexed by a Bethe Tree

Weiguo Yang

DOI: https://doi.org/10.1080/07362994.2012.649619

2012-03-01

Stochastic Analysis and Applications

Abstract:In this article, we establish a class of strong deviation theorems for the random fields which are associated with nonhomogeneous Markov chains indexed by a Bethe tree. As corollaries, we obtain the strong law of large numbers and asymptotic equipartition property for nonhomogeneous Markov chains indexed by such tree.

mathematics, applied,statistics & probability
On exchangeable random variables and the statistics of large graphs and hypergraphs

Tim Austin

DOI: https://doi.org/10.1214/08-PS124

2008-05-26

Abstract:De Finetti's classical result of [18] identifying the law of an exchangeable family of random variables as a mixture of i.i.d. laws was extended to structure theorems for more complex notions of exchangeability by Aldous [1,2,3], Hoover [41,42], Kallenberg [44] and Kingman [47]. On the other hand, such exchangeable laws were first related to questions from combinatorics in an independent analysis by Fremlin and Talagrand [29], and again more recently in Tao [62], where they appear as a natural proxy for the `leading order statistics' of colourings of large graphs or hypergraphs. Moreover, this relation appears implicitly in the study of various more bespoke formalisms for handling `limit objects' of sequences of dense graphs or hypergraphs in a number of recent works, including Lovász and Szegedy [52], Borgs, Chayes, Lovász, Sós, Szegedy and Vesztergombi [17], Elek and Szegedy [24] and Razborov [54,55]. However, the connection between these works and the earlier probabilistic structural results seems to have gone largely unappreciated. In this survey we recall the basic results of the theory of exchangeable laws, and then explain the probabilistic versions of various interesting questions from graph and hypergraph theory that their connection motivates (particularly extremal questions on the testability of properties for graphs and hypergraphs). We also locate the notions of exchangeability of interest to us in the context of other classes of probability measures subject to various symmetries, in particular contrasting the methods employed to analyze exchangeable laws with related structural results in ergodic theory, particular the Furstenberg-Zimmer structure theorem for probability-preserving $\mathbb {Z}$-systems, which underpins Furstenberg's ergodic-theoretic proof of Szemerédi's Theorem. The forthcoming paper [10]--hereditarytest will make a much more elaborate appeal to the link between exchangeable laws and dense (directed) hypergraphs to establish various results in property testing.

Probability,Combinatorics
From Defects to Boundaries

Z. Bajnok,A. George

DOI: https://doi.org/10.1142/S0217751X06025262

2005-01-11

Abstract:In this paper we describe how relativistic field theories containing defects are equivalent to a class of boundary field theories. As a consequence previously derived results for boundaries can be directly applied to defects, these results include reduction formulas, the Coleman-Thun mechanism and Cutcosky rules. For integrable theories the defect crossing unitarity equation can be derived and defect operator found. For a generic purely transmitting impurity we use the boundary bootstrap method to obtain solutions of the defect Yang-Baxter equation. The groundstate energy on the strip with defects is also calculated.

High Energy Physics - Theory
Theory of Boundary Effects in Invasion Percolation

A. Gabrielli,R. Cafiero,G. Caldarelli

DOI: https://doi.org/10.1088/0305-4470/31/37/006

1998-07-29

Abstract:We study the boundary effects in invasion percolation with and without trapping. We find that the presence of boundaries introduces a new set of surface critical exponents, as in the case of standard percolation. Numerical simulations show a fractal dimension, for the region of the percolating cluster near the boundary, remarkably different from the bulk one. We find a logarithmic cross-over from surface to bulk fractal properties, as one would expect from the finite-size theory of critical systems. The distribution of the quenched variables on the growing interface near the boundary self-organises into an asymptotic shape characterized by a discontinuity at a value $x_c=0.5$, which coincides with the bulk critical threshold. The exponent $\tau^{sur}$ of the boundary avalanche distribution for IP without trapping is $\tau^{sur}=1.56\pm0.05$; this value is very near to the bulk one. Then we conclude that only the geometrical properties (fractal dimension) of the model are affected by the presence of a boundary, while other statistical and dynamical properties are unchanged. Furthermore, we are able to present a theoretical computation of the relevant critical exponents near the boundary. This analysis combines two recently introduced theoretical tools, the Fixed Scale Transformation (FST) and the Run Time Statistics (RTS), which are particularly suited for the study of irreversible self-organised growth models with quenched disorder. Our theoretical results are in rather good agreement with numerical data.

Condensed Matter
Boundary effect and quantum phases in spin chains

Jinhyeok Ryu,Jaeyoon Cho

2024-04-30

Abstract:Boundary effect is a widespread idea in many-body theories. However, it is more of a conceptual notion than a rigorously defined physical quantity. One can quantify the boundary effect by comparing two ground states of the same physical model, which differ only slightly in system size. Here, we analyze the quantity, which we call a boundary effect function, for an XXZ spin-1/2 model using density matrix renormalization group calculations. We find that three quantum phases of the model manifest as different functional forms of the boundary effect function. As a result, the quantum phase transition of the model is associated with a nonanalytic change of the boundary effect function. This work thus provides and concretizes a novel perspective on the relationship between bulk and boundary properties of ground states.

Strongly Correlated Electrons,Quantum Physics
Boundary dynamics for holomorphic sequences, non-autonomous dynamical systems and wandering domains

Anna Miriam Benini,Vasiliki Evdoridou,Núria Fagella,Philip J. Rippon,Gwyneth M. Stallard

2023-06-27

Abstract:There are many classical results, related to the Denjoy--Wolff Theorem, concerning the relationship between orbits of interior points and orbits of boundary points under iterates of holomorphic self-maps of the unit disc. Here, for the first time, we address such questions in the very general setting of sequences $(F_n)$ of holomorphic maps between simply connected domains. We show that, while some classical results can be generalised, with an interesting dependence on the geometry of the domains, a much richer variety of behaviours is possible. Some of our results are new even in the classical setting. Our methods apply in particular to non-autonomous dynamical systems, when $(F_n)$ are forward compositions of holomorphic maps, and to the study of wandering domains in holomorphic dynamics. The proofs use techniques from geometric function theory, measure theory and ergodic theory, and the construction of examples involves a `weak independence' version of the second Borel--Cantelli lemma and the concept from ergodic theory of `shrinking targets'.

Dynamical Systems,Complex Variables
On large deviation principles and the Monge--Ampère equation (following Berman, Hultgren)

Yanir A. Rubinstein

DOI: https://doi.org/10.1007/978-3-031-17859-7_40

2022-06-10

Abstract:This is mostly an exposition, aimed to be accessible to geometers, analysts, and probabilists, of a fundamental recent theorem of R. Berman with recent developments by J. Hultgren, that asserts that the second boundary value problem for the real Monge--Ampère equation admits a probabilistic interpretation, in terms of many particle limit of permanental point processes satisfying a large deviation principle with a rate function given explicitly using optimal transport. An alternative proof of a step in the Berman--Hultgren Theorem is presented allowing to to deal with all "tempratures" simultaneously instead of first reducing to the zero-temperature case.

Probability,Analysis of PDEs,Differential Geometry
On time-dependent boundary crossing probabilities of diffusion processes as differentiable functionals of the boundary

Vincent Liang,Konstantin Borovkov

2024-08-20

Abstract:The paper analyses the sensitivity of the finite time horizon boundary non-crossing probability $F(g)$ of a general time-inhomogeneous diffusion process to perturbations of the boundary $g$. We prove that, for boundaries $g\in C^2,$ this probability is Gâteaux differentiable in directions $h \in H \cup C^2$ and Fréchet-differentiable in directions $h \in H,$ where $H$ is the Cameron--Martin space, and derive a compact representation for the derivative of $F$. Our results allow one to approximate $F(g)$ using boundaries $\bar{g}$ that are close to $g$ and for which the computation of $F(\bar{g})$ is feasible. We also obtain auxiliary results of independent interest in both probability theory and PDE theory. These include: (i) an elegant probabilistic representation for the limit of the derivative with respect to $x$ of the boundary crossing probability when the process starts at point $(t,x)$ in the time-space domain and $x\uparrow g(t),$ and (ii) a Shiryaev--Yor type martingale representation for the indicator of the boundary non-crossing event for time-dependent boundaries.

Probability

A boundary theory approach to de Finetti's theorem

Proof of the Diaconis--Freedman Conjecture on partially-exchangeable processes

Generalizing the de Finetti--Hewitt--Savage theorem

De Finetti's theorem and related results for infinite weighted exchangeable sequences

Connecting classical finite exchangeability to quantum theory

On a boundary of the central limit theorem for strictly stationary, reversible Markov chains

Variations on quantum de Finetti theorems and operator valued Martin boundaries: a Choquet-Deny approach

Boundary trace theorems for symmetric reflected diffusions

Coag-Frag duality for a class of stable Poisson-Kingman mixtures

Finite and infinite weighted exchangeable sequences

A de Finetti theorem for quantum causal structures

Finite de Finetti bounds in relative entropy

A Third Information-Theoretic Approach to Finite de Finetti Theorems

A Class of Strong Deviation Theorems for the Random Fields Associated with Nonhomogeneous Markov Chains Indexed by a Bethe Tree

On exchangeable random variables and the statistics of large graphs and hypergraphs

From Defects to Boundaries

Theory of Boundary Effects in Invasion Percolation

Boundary effect and quantum phases in spin chains

Boundary dynamics for holomorphic sequences, non-autonomous dynamical systems and wandering domains

On large deviation principles and the Monge--Ampère equation (following Berman, Hultgren)

On time-dependent boundary crossing probabilities of diffusion processes as differentiable functionals of the boundary