Uniform Convergence and the Central Limit Theorem

John D. Williams

DOI: https://doi.org/10.1007/s11785-010-0100-7

2011-04-09

Abstract:We prove results about uniform convergence of densities in the free central limit theorem without assumptions of boundedness on the support.

Operator Algebras,Functional Analysis

What problem does this paper attempt to address?

On Central Limit Theorems for Vector Random Measures and Measure-Valued Processes

ZG Su

DOI: https://doi.org/10.1137/s0040585x97979111

2002-01-01

Theory of Probability and Its Applications

Abstract:Let B be a separable Banach space, Suppose that (F. F-t, greater than or equal to 1) is a sequence of independent identically distributed (i.i.d.) and symmetrical (s.i.s.) B-valued random measures. We first establish the central limit theorem for Y-n = 1/rootn Sigma(i=1)(n) F-t by taking the viewpoint of random linear functionals on Schwartz distribution spaces, Then let (X, X-i, i greater than or equal to 1) be a sequence of i.i.d. symmetric B-valued random vectors and (B, B-i, i greater than or equal to 1) a sequence of independent standard Brownian motions on [0,1] independent of (X, X-t, i greater than or equal to 1). The central limit theorem for measure-valued processes Z(n)(t) = 1/rootn Sigma(i=1)(n) X(i)delta(Bi)(t). t is an element of [0, 1], will be investigated in the same frame. Our main results concerning Y-n differ front D. H. Thang's [Probab. Theory Related Fields, 88 (1991), pp. 1-16] in that we take into account F as a whole: while the results related to Z(n) are extensions of I. Mitoma [Ann. Probab., 11 (1983), pp. 989 099] to random weighted mass.
An almost everywhere central limit theorem

Gunnar A. Brosamler

DOI: https://doi.org/10.1017/s0305004100065750

1988-11-01

Mathematical Proceedings of the Cambridge Philosophical Society

Abstract:The purpose of this paper is the proof of an almost everywhere version of the classical central limit theorem (CLT). As is well known, the latter states that for IID random variables Y 1 , Y 2 , ... on a probability space (Ω, , P ) with we have weak convergence of the distributions of to the standard normal distribution on R. We recall that weak convergence of finite measures μ n on a metric space S to a finite measure μ on S is defined to mean that for all bounded, continuous real functions on S . Equivalently, one may require the validity of (1·1) only for bounded, uniformly continuous real functions, or even for all bounded measurable real functions which are μ-a.e. continuous.

mathematics
Central Limit Theorem

Amrita Kaur,Y. Poiλ

DOI: https://doi.org/10.1002/9780470012505.TAC019

2006-09-15

Abstract:The Central Limit Theorem (CLT) is generally regarded as a generic name applied to any theorem giving convergence in distribution, especially to the normal law, of normed sums of an increasing number of random variables. Results of this kind hold under far reaching circumstances, and they have, in particular, given the normal distribution a central place in probability theory and statistics. Keywords: asymptotic normality; limit laws; weak convergence

Mathematics
Uniform convergence for convexification of dominated pointwise convergent continuous functions

Zoltan Kannai

DOI: https://doi.org/10.48550/arXiv.0809.0393

2008-09-02

Abstract:The Lebesgue dominated convergence theorem of the measure theory implies that the Riemann integral of a bounded sequence of continuous functions over the interval [ 0,1] pointwise converging to zero, also converges to zero. The validity of this result is independent of measure theory, on the other hand, this result together with only elementary functional analysis, can generate measure theory itself. The mentioned result was also known before the appearance of measure theory, but the original proof was very complicated. For this reason this result, when presented in teaching, is generally obtained based on measure theory. Later, Eberlein gave an elementary, but still relatively complicated proof, and there were other simpler proofs but burdened with complicated concepts, like measure theory. In this paper we give a short and elementary proof even for the following strenghened form of the mentioned result: a bounded sequence of continuous functions defined on a compact topological space K pointwise converging to zero, has a suitable convexification converging also uniformly to zero on $K,$ thus, e.g., the original sequence converges weakly to zero in C(K). This fact can also be used in the proof of the Krein-Smulian theorem. The usual proof beyond the simple tools of the functional analysis, uses heavy embedding theorems and the Riesz' representation theorem with the whole apparatus of measure theory. Our main result, however, reduces the cited proof to a form in which we need abstract tools only, namely the Hahn-Banach separation theorem and Alaoglu's theorem, without Riesz' representation or any statement of measure theory.

Functional Analysis
Central limits from generating functions

Mitchell Lee

2024-10-08

Abstract:Let $(Y_n)_n$ be a sequence of $\mathbb{R}^d$-valued random variables. Suppose that the generating function \[f(x, z) = \sum_{n = 0}^\infty \varphi_{Y_n}(x) z^n,\] where $\varphi_{Y_n}$ is the characteristic function of $Y_n$, extends to a function on a neighborhood of $\{0\} \times \{z : |z| \leq 1\} \subset \mathbb{R}^d \times \mathbb{C}$ which is meromorphic in $z$ and has no zeroes. We prove that if $1 / f(x, z)$ is twice differentiable, then there exists a constant $\mu$ such that the distribution of $(Y_n - \mu n) / \sqrt{n}$ converges weakly to a normal distribution as $n \to \infty$. If $Y_n = X_1 + \cdots + X_n$, where $(X_n)_n$ are i.i.d. random variables, then we recover the classical (Lindeberg$\unicode{x2013}$Lévy) central limit theorem. We also prove the 2020 conjecture of Defant that if $\pi_n \in \mathfrak{S}_n$ is a uniformly random permutation, then the distribution of $(\operatorname{des} (s(\pi_n)) + 1 - (3 - e) n) / \sqrt{n}$ converges, as $n \to \infty$, to a normal distribution with variance $2 + 2e - e^2$.

Probability
Central limit theorems for the shrinking target problem

Nicolai Haydn,Matthew Nicol,Sandro Vaienti,Licheng Zhang

DOI: https://doi.org/10.1007/s10955-013-0860-3

2013-05-27

Abstract:Suppose $B_i:= B(p,r_i)$ are nested balls of radius $r_i$ about a point $p$ in a dynamical system $(T,X,\mu)$. The question of whether $T^i x\in B_i$ infinitely often (i. o.) for $\mu$ a.e.\ $x$ is often called the shrinking target problem. In many dynamical settings it has been shown that if $E_n:=\sum_{i=1}^n \mu (B_i)$ diverges then there is a quantitative rate of entry and $\lim_{n\to \infty} \frac{1}{E_n} \sum_{j=1}^{n} 1_{B_i} (T^i x) \to 1$ for $\mu$ a.e. $x\in X$. This is a self-norming type of strong law of large numbers. We establish self-norming central limit theorems (CLT) of the form $\lim_{n\to \infty} \frac{1}{a_n} \sum_{i=1}^{n} [1_{B_i} (T^i x)-\mu(B_i)] \to N(0,1)$ (in distribution) for a variety of hyperbolic and non-uniformly hyperbolic dynamical systems, the normalization constants are $a^2_n \sim E [\sum_{i=1}^n 1_{B_i} (T^i x)-\mu(B_i)]^2$. Dynamical systems to which our results apply include smooth expanding maps of the interval, Rychlik type maps, Gibbs-Markov maps, rational maps and, in higher dimensions, piecewise expanding maps. For such central limit theorems the main difficulty is to prove that the non-stationary variance has a limit in probability.

Dynamical Systems
The Sufficient and Necessary Conditions of the Strong Law of Large Numbers under Sub-Linear Expectations

Li Xin Zhang

DOI: https://doi.org/10.1007/s10114-023-1103-4

2023-01-01

Acta Mathematica Sinica English Series

Abstract:In this paper, by establishing a Borel–Cantelli lemma for a capacity which is not necessarily continuous, and a link between a sequence of independent random variables under the sub-linear expectation and a sequence of independent random variables on ℝ∞ under a probability, we give the sufficient and necessary conditions of the strong law of large numbers for independent and identically distributed random variables under the sub-linear expectation, and the sufficient and necessary conditions for the convergence of an infinite series of independent random variables, without the assumption on the continuity of the capacities. A purely probabilistic proof of a weak law of large numbers is also given.
The Convergence of the Sums of Independent Random Variables under the Sub-Linear Expectations

Li Xin Zhang

DOI: https://doi.org/10.1007/s10114-020-8508-0

2020-01-01

Acta Mathematica Sinica English Series

Abstract:Let {Xn;n ≥ 1} be a sequence of independent random variables on a probability space (Ω,F,P) and $${S_n} = \sum\nolimits_{k = 1}^n {{X_k}} $$. It is well-known that the almost sure convergence, the convergence in probability and the convergence in distribution of Sn are equivalent. In this paper, we prove similar results for the independent random variables under the sub-linear expectations, and give a group of sufficient and necessary conditions for these convergence. For proving the results, the Levy and Kolmogorov maximal inequalities for independent random variables under the sub-linear expectation are established. As an application of the maximal inequalities, the sufficient and necessary conditions for the central limit theorem of independent and identically distributed random variables are also obtained.
Central limit theorems for Fréchet means on stratified spaces

Jonathan C. Mattingly,Ezra Miller,Do Tran

2023-11-16

Abstract:Fréchet means of samples from a probability measure $\mu$ on any smoothly stratified metric space M with curvature bounded above are shown to satisfy a central limit theorem (CLT). The methods and results proceed by introducing and proving analytic properties of the "escape vector" of any finitely supported measure $\delta$ in M, which records infinitesimal variation of the Fréchet mean $\bar\mu$ of $\mu$ in response to perturbation of $\mu$ by adding the mass $t\delta$ for $t \to 0$. The CLT limiting distribution $N$ on the tangent cone $T$ at the Fréchet mean is characterized in four ways. The first uses tangential collapse $L$ to compare $T$ with a linear space and then applies a distortion map to the usual linear CLT to transfer back to $T$. Distortion is defined by applying escape after taking preimages under $L$. The second characterization constructs singular analogues of Gaussian measures on smoothly stratified spaces and expresses $N$ as the escape vector of any such "Gaussian mass". The third characterization expresses $N$ as the directional derivative, in the space of measures on $M$, of the barycenter map at $\mu$ in the (random) direction given by any Gaussian mass. The final characterization expresses $N$ as the directional derivative, in the space $C$ of continuous real-valued functions on $T$, of a minimizer map, with the derivative taken at the Fréchet function $F \in C$ along the (random) direction given by the negative of the Gaussian tangent field induced by $\mu$. Precise mild hypotheses on the measure $\mu$ guarantee these CLTs, whose convergence is proved via the second characterization of $N$ by formulating a duality between Gaussian masses and Gaussian tangent fields.

Probability,Metric Geometry,Statistics Theory
Convergence to the uniform distribution of moderately self-interacting diffusions on compact Riemannian manifolds

Simon Holbach,Olivier Raimond

2023-08-28

Abstract:We consider a self-interacting diffusion $X$ on a smooth compact Riemannian manifold $\Bbb M$, described by the stochastic differential equation \[ dX_t = \sqrt{2} dW_t(X_t)- \beta(t) \nabla V_t(X_t)dt, \] where $\beta$ is suitably lower-bounded and grows at most logarithmically, and \[ V_t(x)=\frac{1}{t}\int_0^t V(x,X_s)ds \] for a suitable smooth function $V\colon \Bbb M^2\to\Bbb R$ that makes the term $-\nabla V_t(X_t)$ self-repelling. We prove that the normalized occupation measure $\mu_t$ of $X$ converges almost surely in total variation to the uniform distribution $\mathcal U$, and we provide a polynomial rate of convergence. The key to this result is showing that $\mu_{e^t}$ shadows the solution to the measure valued ordinary differential equation \[ \dot\nu_t=-\nu_t+\mathcal U. \] This work complements and extends results from [Raimond 2009] and [Benaïm, Ledoux, Raimond 2002].

Probability
A note on convergence of densities to free extreme value distributions

Yamato Kindaichi,Yuki Ueda

2024-08-16

Abstract:The concept of free extreme value distributions as universal limit laws for the spectral maximum of free noncommutative real random variables was discovered by Ben Arous and Voiculescu in 2006. This paper contributes to study the convergence of densities towards free extreme value distributions under the von Mises condition for sample distributions.

Probability
Uniform Convergence Rate of the Kernel Density Estimator Adaptive to Intrinsic Volume Dimension

Jisu Kim,Jaehyeok Shin,Alessandro Rinaldo,Larry Wasserman

DOI: https://doi.org/10.48550/arXiv.1810.05935

2019-12-31

Abstract:We derive concentration inequalities for the supremum norm of the difference between a kernel density estimator (KDE) and its point-wise expectation that hold uniformly over the selection of the bandwidth and under weaker conditions on the kernel and the data generating distribution than previously used in the literature. We first propose a novel concept, called the volume dimension, to measure the intrinsic dimension of the support of a probability distribution based on the rates of decay of the probability of vanishing Euclidean balls. Our bounds depend on the volume dimension and generalize the existing bounds derived in the literature. In particular, when the data-generating distribution has a bounded Lebesgue density or is supported on a sufficiently well-behaved lower-dimensional manifold, our bound recovers the same convergence rate depending on the intrinsic dimension of the support as ones known in the literature. At the same time, our results apply to more general cases, such as the ones of distribution with unbounded densities or supported on a mixture of manifolds with different dimensions. Analogous bounds are derived for the derivative of the KDE, of any order. Our results are generally applicable but are especially useful for problems in geometric inference and topological data analysis, including level set estimation, density-based clustering, modal clustering and mode hunting, ridge estimation and persistent homology.

Statistics Theory
Entropic Central Limit Theorem for Order Statistics

Martina Cardone,Alex Dytso,Cynthia Rush

DOI: https://doi.org/10.1109/tit.2022.3219344

IF: 2.5

2023-03-18

IEEE Transactions on Information Theory

Abstract:It is well known that central order statistics exhibit a central limit behavior and converge to a Gaussian distribution as the sample size grows. This paper strengthens this known result by establishing an entropic version of the central limit theorem that ensures a stronger mode of convergence using the relative entropy. This upgrade in convergence is shown at the expense of extra regularity conditions, which can be considered as mild. To prove this result, ancillary results on order statistics are derived, which might be of independent interest. For instance, a rather general bound on the moments of order statistics, and an upper bound on the mean squared error of estimating the -th quantile of an unknown cumulative distribution function, are derived. Finally, a discussion on the necessity of the derived conditions for convergence and on the rate of convergence and monotonicity of the relative entropy is provided.

computer science, information systems,engineering, electrical & electronic
Uniform convergence of conditional distributions for one-dimensional diffusion processes

Guoman He,Hanjun Zhang

2023-09-09

Abstract:In this paper, we study the quasi-stationary behavior of the one-dimensional diffusion process with a regular or exit boundary at 0 and an entrance boundary at $\infty$. By using the Doob's $h$-transform, we show that the conditional distribution of the process converges to its unique quasi-stationary distribution exponentially fast in the total variation norm, uniformly with respect to the initial distribution. Moreover, we also use the same method to show that the conditional distribution of the process converges exponentially fast in the $\psi$-norm to the unique quasi-stationary distribution.

Probability
The linearization of the central limit operator in free probability theory

Michael Anshelevich

DOI: https://doi.org/10.48550/arXiv.math/9810047

1999-09-16

Abstract:We interpret the Central Limit Theorem as a fixed point theorem for a certain operator, and consider the problem of linearizing this operator. In classical as well as in free probability theory, we consider two methods giving such a linearization, and interpret the result as a weak form of the CLT. In the classical case the analysis involves dilation operators; in the free case more general composition operators appear.

Operator Algebras,Probability
Uniform convergence of stochastic semigroups

Jochen Glück,Florian G. Martin

DOI: https://doi.org/10.48550/arXiv.2005.08372

2020-05-18

Abstract:For stochastic $C_0$-semigroups on $L^1$-spaces there is wealth of results that show strong convergence to an equilibrium as $t \to \infty$, given that the semigroup contains a partial integral operator. This has plenty of applications to transport equations and in mathematical biology. However, up to now partial integral operators do not play a prominent role in theorems which yield uniform convergence of the semigroup rather than only strong convergence. In this article we prove that, for irreducible stochastic semigroups, uniform convergence to an equilibrium is actually equivalent to being partially integral and uniformly mean ergodic. In addition to this Tauberian theorem, we also show that our semigroup is uniformly convergent if and only if it is partially integral and the dual semigroup satisfies a certain irreducibility condition. Our proof is based on a uniform version of a lower bound theorem of Lasota and Yorke, which we combine with various techniques from Banach lattice theory.

Functional Analysis
Central Limit Theorems for Smooth Optimal Transport Maps

Tudor Manole,Sivaraman Balakrishnan,Jonathan Niles-Weed,Larry Wasserman

2024-09-17

Abstract:One of the central objects in the theory of optimal transport is the Brenier map: the unique monotone transformation which pushes forward an absolutely continuous probability law onto any other given law. A line of recent work has analyzed $L^2$ convergence rates of plugin estimators of Brenier maps, which are defined as the Brenier map between density estimators of the underlying distributions. In this work, we show that such estimators satisfy a pointwise central limit theorem when the underlying laws are supported on the flat torus of dimension $d \geq 3$. We also derive a negative result, showing that these estimators do not converge weakly in $L^2$ when the dimension is sufficiently large. Our proofs hinge upon a quantitative linearization of the Monge-Ampère equation, which may be of independent interest. This result allows us to reduce our problem to that of deriving limit laws for the solution of a uniformly elliptic partial differential equation with a stochastic right-hand side, subject to periodic boundary conditions.

Probability,Analysis of PDEs,Statistics Theory
Concentration of Randomized Functions of Uniformly Bounded Variation

Thomas Anton,Sutanuka Roy,Rabee Tourky

2023-12-22

Abstract:A sharp, distribution free, non-asymptotic result is proved for the concentration of a random function around the mean function, when the randomization is generated by a finite sequence of independent data and the random functions satisfy uniform bounded variation assumptions. The specific motivation for the work comes from the need for inference on the distributional impacts of social policy intervention. However, the family of randomized functions that we study is broad enough to cover wide-ranging applications. For example, we provide a Kolmogorov-Smirnov like test for randomized functions that are almost surely Lipschitz continuous, and novel tools for inference with heterogeneous treatment effects. A Dvoretzky-Kiefer-Wolfowitz like inequality is also provided for the sum of almost surely monotone random functions, extending the famous non-asymptotic work of Massart for empirical cumulative distribution functions generated by i.i.d. data, to settings without micro-clusters proposed by Canay, Santos, and Shaikh. We illustrate the relevance of our theoretical results for applied work via empirical applications. Notably, the proof of our main concentration result relies on a novel stochastic rendition of the fundamental result of Debreu, generally dubbed the "gap lemma," that transforms discontinuous utility representations of preorders into continuous utility representations, and on an envelope theorem of an infinite dimensional optimisation problem that we carefully construct.

Probability,Methodology
Central Limit Theorem for Rényi Divergence of Infinite Order

Sergey G. Bobkov,Friedrich Götze

2024-06-19

Abstract:For normalized sums $Z_n$ of i.i.d. random variables, we explore necessary and sufficient conditions which guarantee the normal approximation with respect to the Rényi divergence of infinite order. In terms of densities $p_n$ of $Z_n$, this is a strengthened variant of the local limit theorem taking the form $\sup_x (p_n(x) - \varphi(x))/\varphi(x) \rightarrow 0$ as $n \rightarrow \infty$.

Probability
Central limit theorems with a rate of convergence for sequences of transformations

Olli Hella

DOI: https://doi.org/10.48550/arXiv.1811.06062

2019-10-16

Abstract:Using Stein's method, we prove an abstract result that yields multivariate central limit theorems with a rate of convergence for time-dependent dynamical systems. As examples we study a model of expanding circle maps and a quasistatic model. In both models we prove multivariate central limit theorems with a rate of convergence.

Probability,Dynamical Systems

Uniform Convergence and the Central Limit Theorem

On Central Limit Theorems for Vector Random Measures and Measure-Valued Processes

An almost everywhere central limit theorem

Central Limit Theorem

Uniform convergence for convexification of dominated pointwise convergent continuous functions

Central limits from generating functions

Central limit theorems for the shrinking target problem

The Sufficient and Necessary Conditions of the Strong Law of Large Numbers under Sub-Linear Expectations

The Convergence of the Sums of Independent Random Variables under the Sub-Linear Expectations

Central limit theorems for Fréchet means on stratified spaces

Convergence to the uniform distribution of moderately self-interacting diffusions on compact Riemannian manifolds

A note on convergence of densities to free extreme value distributions

Uniform Convergence Rate of the Kernel Density Estimator Adaptive to Intrinsic Volume Dimension

Entropic Central Limit Theorem for Order Statistics

Uniform convergence of conditional distributions for one-dimensional diffusion processes

The linearization of the central limit operator in free probability theory

Uniform convergence of stochastic semigroups

Central Limit Theorems for Smooth Optimal Transport Maps

Concentration of Randomized Functions of Uniformly Bounded Variation

Central Limit Theorem for Rényi Divergence of Infinite Order

Central limit theorems with a rate of convergence for sequences of transformations