Abstract:We revisit the question of whether the strong law of large numbers (SLLN) holds uniformly in a rich family of distributions, culminating in a distribution-uniform generalization of the Marcinkiewicz-Zygmund SLLN. These results can be viewed as extensions of Chung's distribution-uniform SLLN to random variables with uniformly integrable $q^\text{th}$ absolute central moments for $0 < q < 2$. Furthermore, we show that uniform integrability of the $q^\text{th}$ moment is both sufficient and necessary for the SLLN to hold uniformly at the Marcinkiewicz-Zygmund rate of $n^{1/q - 1}$. These proofs centrally rely on novel distribution-uniform analogues of some familiar almost sure convergence results including the Khintchine-Kolmogorov convergence theorem, Kolmogorov's three-series theorem, a stochastic generalization of Kronecker's lemma, and the Borel-Cantelli lemmas. We also consider the non-identically distributed case.

THE UNIVERSAL NORM DISTRIBUTION AND SINNOTT'S INDEX FORMULA

On the universal norm distribution

Spectral sequences of universal distribution and Sinnott's index formula

Studentized Increments of Partial-Sums

A central limit theorem for studentized U-statistics

Functional Limit Theorems for the Infinite Series of OU Processes in Hölder Norm

On Increments of Sums of Independent Non-Identically Distributed Random-Variables

Norm inequalities in and a geometric constant

On the distribution of the norm of partitions

Distribution of Normalized Zero-Sets of Random Entire Functions

The Dual Normal Chip and Linear Regularity for Infinite Systems of Convex Sets in Banach Spaces

A Limit Result for Self-Normalized Random Sums

Index-class number formulas over global function fields

On the norm of the lower central series in a finite group

The distribution of ideals whose norm divides $ n $ in the Gaussian ring

A generalized normal distribution

Distribution Estimation under the Infinity Norm

Variation comparison between infinitely divisible distributions and the normal distribution

The distributive equations for idempotent uninorms and nullnorms

Distribution-uniform strong laws of large numbers

A conjecture of Mallows and Sloane with the universal denominator of Hilbert series