From biased coin to any discrete distribution

Karol Gryszka

DOI: https://doi.org/10.1007/s10998-020-00363-w

2020-10-29

Periodica Mathematica Hungarica

Abstract:Abstract In this note we construct an algorithm generating any discrete distribution with an arbitrary coin (and, as a result, with arbitrary initial distribution). The coin need not be fair and the target distribution can be supported on a countable set.

mathematics, applied

What problem does this paper attempt to address?

Induced Distributions from Generalized Unfair Dice

Douglas T. Pfeffer,J. Darby Smith,William Severa

2023-09-20

Abstract:In this paper we analyze the probability distributions associated with rolling (possibly unfair) dice infinitely often. Specifically, given a $q$-sided die, if $x_i\in\{0,\ldots,q-1\}$ denotes the outcome of the $i^{\text{th}}$ toss, then the distribution function is $F(x)=\mathbb{P}[X\leq x]$, where $X = \sum_{i=1}^\infty x_i q^{-i}$. We show that $F$ is singular and establish a piecewise linear, iterative construction for it. We investigate two ways of comparing $F$ to the fair distribution -- one using supremum norms and another using arclength. In the case of coin flips, we also address the case where each independent flip could come from a different distribution. In part, this work aims to address outstanding claims in the literature on Bernoulli schemes. The results herein are motivated by emerging needs, desires, and opportunities in computation to leverage physical stochasticity in microelectronic devices for random number generation.

Probability
Optimal Discrete Uniform Generation from Coin Flips, and Applications

Jérémie Lumbroso

DOI: https://doi.org/10.48550/arXiv.1304.1916

2013-04-07

Abstract:This article introduces an algorithm to draw random discrete uniform variables within a given range of size n from a source of random bits. The algorithm aims to be simple to implement and optimal both with regards to the amount of random bits consumed, and from a computational perspective---allowing for faster and more efficient Monte-Carlo simulations in computational physics and biology. I also provide a detailed analysis of the number of bits that are spent per variate, and offer some extensions and applications, in particular to the optimal random generation of permutations.

Data Structures and Algorithms,Probability,Computational Physics,Data Analysis, Statistics and Probability
A Remark on Sieving in Biased Coin Convolutions

Mei-Chu Chang

DOI: https://doi.org/10.48550/arXiv.1506.00733

2015-06-02

Abstract:In this work, we establish a nontrivial level of distribution for densities on $\{1,\ldots, N\}$ obtained by a biased coin convolution. As a consequence of sieving theory, one then derives the expected lower bound for the weight of such densities on sets of pseudo-primes.

Number Theory
Simulating a die roll by flipping two coins

Giovanni Viglietta

DOI: https://doi.org/10.48550/arXiv.1506.00086

2015-05-30

Abstract:We show how to simulate a roll of a fair $n$-sided die by one flip of a biased coin with probability $1/n$ of coming up heads, followed by $3\lfloor\log_2 n \rfloor+1$ flips of a fair coin.

Combinatorics,Discrete Mathematics
Locally Sampleable Uniform Symmetric Distributions

Daniel M. Kane,Anthony Ostuni,Kewen Wu

2024-11-13

Abstract:We characterize the power of constant-depth Boolean circuits in generating uniform symmetric distributions. Let $f\colon\{0,1\}^m\to\{0,1\}^n$ be a Boolean function where each output bit of $f$ depends only on $O(1)$ input bits. Assume the output distribution of $f$ on uniform input bits is close to a uniform distribution $D$ with a symmetric support. We show that $D$ is essentially one of the following six possibilities: (1) point distribution on $0^n$, (2) point distribution on $1^n$, (3) uniform over $\{0^n,1^n\}$, (4) uniform over strings with even Hamming weights, (5) uniform over strings with odd Hamming weights, and (6) uniform over all strings. This confirms a conjecture of Filmus, Leigh, Riazanov, and Sokolov (RANDOM 2023).

Computational Complexity
Probabilistic vs deterministic gamblers

Laurent Bienvenu,Valentino Delle Rose,Tomasz Steifer

DOI: https://doi.org/10.48550/arXiv.2112.04460

2021-12-09

Abstract:Can a probabilistic gambler get arbitrarily rich when all deterministic gamblers fail? We study this problem in the context of algorithmic randomness, introducing a new notion -- almost everywhere computable randomness. A binary sequence $X$ is a.e.\ computably random if there is no probabilistic computable strategy which is total and succeeds on $X$ for positive measure of oracles. Using the fireworks technique we construct a sequence which is partial computably random but not a.e.\ computably random. We also prove the separation between a.e.\ computable randomness and partial computable randomness, which happens exactly in the uniformly almost everywhere dominating Turing degrees.

Logic
How to Lose with Least Probability

Robert W. Chen,Burton Rosenberg

DOI: https://doi.org/10.48550/arXiv.1112.2117

2011-12-14

Abstract:Two players alternate tossing a biased coin where the probability of getting heads is p. The current player is awarded alpha points for tails and alpha+beta for heads. The first player reaching n points wins. For a completely unfair coin the player going first certainly wins. For other coin biases, the player going first has the advantage, but the advantage depends on the coin bias. We calculate the first player's advantage and the coin bias minimizing this advantage.

Probability,Computer Science and Game Theory,Combinatorics
A new infinitely divisible discrete distribution with applications to count data modeling

Deepesh Bhati,Hassan S. Bakouch

DOI: https://doi.org/10.1080/03610926.2018.1433847

2018-03-01

Abstract:A new discrete distribution involving geometric and discrete Pareto as special cases is introduced. The distribution possesses many interesting properties like decreasing hazard rate, zero vertex uni-modality, over-dispersion, infinite divisibility and compound Poisson representation, which makes the proposed distribution well suited for count data modeling. Other issues including closure property under minima, comparison of its distribution tail with other distributions via actuarial indices are discussed. The method of proportion and maximum likelihood method are presented for parameter estimation. Finally the performance of the proposed distribution over other classical and newly proposed infinitely divisible distributions are discussed.
Simulating a coin with irrational bias using rational arithmetic

Luis Mendo

2024-08-20

Abstract:An algorithm is presented that, taking a sequence of independent Bernoulli random variables with parameter $1/2$ as inputs and using only rational arithmetic, simulates a Bernoulli random variable with possibly irrational parameter $\tau$. It requires a series representation of $\tau$ with positive, rational terms, and a rational bound on its truncation error that converges to $0$. The number of required inputs has an exponentially bounded tail, and its mean is at most $3$. The number of arithmetic operations has a tail that can be bounded in terms of the sequence of truncation error bounds. The algorithm is applied to two specific values of $\tau$, including Euler's constant, for which obtaining a simple simulation algorithm was an open problem.

Probability,Computation
Generalizing the de Finetti--Hewitt--Savage theorem

Irfan Alam

2023-06-21

Abstract:A sequence of random variables is called exchangeable if its joint distribution is invariant under permutations. The original formulation of de Finetti's theorem says that any exchangeable sequence of $\{0,1\}$-valued random variables can be thought of as a mixture of independent and identically distributed sequences in a certain precise mathematical sense. Interpreting this statement from a convex analytic perspective, Hewitt and Savage obtained the same conclusion for more general state spaces under some topological conditions. The main contribution of this paper is in providing a new framework that explains the theorem purely as a consequence of the underlying distribution of the random variables, with no topological conditions (beyond Hausdorffness) on the state space being necessary if the distribution is Radon. We also show that it is consistent with the axioms of ZFC that de Finetti's theorem holds for all sequences of exchangeable random variables taking values in any complete metric space. The framework we use is based on nonstandard analysis. We have provided a self-contained introduction to nonstandard analysis as an appendix, thus rendering measure theoretic probability and point-set topology as the only prerequisites for this paper. Our introduction aims to develop some new ideologies that might be of interest to mathematicians, philosophers, and mathematics educators alike. Our technical tools come from nonstandard topological measure theory, in which a highlight is a new generalization of Prokhorov's theorem. Modulo such technical tools, our proof relies on properties of the empirical measures induced by hyperfinitely many identically distributed random variables -- a feature that allows us to establish de Finetti's theorem in the generality that we seek while still retaining the combinatorial intuition of proofs of simpler versions of de Finetti's theorem.

Probability,Logic,Statistics Theory
Fair Coin Flipping: Tighter Analysis and the Many-Party Case

Niv Buchbinder,Iftach Haitner,Nissan Levi,Eliad Tsfadia

DOI: https://doi.org/10.1137/1.9781611974782.170

2022-06-17

Abstract:In a multi-party fair coin-flipping protocol, the parties output a common (close to) unbiased bit, even when some adversarial parties try to bias the output. In this work we focus on the case of an arbitrary number of corrupted parties. Cleve [STOC 1986] has shown that in any such $m$-round coin-flipping protocol, the corrupted parties can bias the honest parties' common output bit by $\Theta(1/m)$. For more than two decades, the best known coin-flipping protocol was the one of Awerbuch et al. [Manuscript 1985], who presented a $t$-party, $m$-round protocol with bias $\Theta(t/\sqrt{m})$. This was changed by the breakthrough result of Moran et al. [TCC 2009], who constructed an $m$-round, two-party coin-flipping protocol with optimal bias $\Theta(1/m)$. Haitner and Tsfadia [STOC 2014] constructed an $m$-round, three-party coin-flipping protocol with bias $O(\log^3m / m)$. Still for the case of more than three parties, the best known protocol remained the $\Theta(t/\sqrt{m})$-bias protocol of Awerbuch et al. We make a step towards eliminating the above gap, presenting a $t$-party, $m$-round coin-flipping protocol, with bias $O(\frac{t^4 \cdot 2^t \cdot \sqrt{\log m}}{m^{1/2+1/\left(2^{t-1}-2\right)}})$ for any $t\le \tfrac12 \log\log m$. This improves upon the $\Theta(t/\sqrt{m})$-bias protocol of Awerbuch et al., and in particular, for $t\in O(1)$ it is an $1/m^{\frac12 + \Theta(1)}$-bias protocol. For the three-party case, it is an $O(\sqrt{\log m}/m)$-bias protocol, improving over the $O(\log^3m / m)$-bias protocol of Haitner and Tsfadia. Our protocol generalizes that of Haitner and Tsfadia, by presenting an appropriate recovery protocol for the remaining parties to interact in, in the case that some parties abort or are caught cheating. We prove the fairness of the new protocol by presenting a new paradigm for analyzing fairness of coin-flipping protocols.

Cryptography and Security
Distribution-uniform anytime-valid sequential inference

Ian Waudby-Smith,Edward H. Kennedy,Aaditya Ramdas

2024-04-19

Abstract:Are asymptotic confidence sequences and anytime $p$-values uniformly valid for a nontrivial class of distributions $\mathcal{P}$? We give a positive answer to this question by deriving distribution-uniform anytime-valid inference procedures. Historically, anytime-valid methods -- including confidence sequences, anytime $p$-values, and sequential hypothesis tests that enable inference at stopping times -- have been justified nonasymptotically. Nevertheless, asymptotic procedures such as those based on the central limit theorem occupy an important part of statistical toolbox due to their simplicity, universality, and weak assumptions. While recent work has derived asymptotic analogues of anytime-valid methods with the aforementioned benefits, these were not shown to be $\mathcal{P}$-uniform, meaning that their asymptotics are not uniformly valid in a class of distributions $\mathcal{P}$. Indeed, the anytime-valid inference literature currently has no central limit theory to draw from that is both uniform in $\mathcal{P}$ and in the sample size $n$. This paper fills that gap by deriving a novel $\mathcal{P}$-uniform strong Gaussian approximation theorem. We apply some of these results to obtain an anytime-valid test of conditional independence without the Model-X assumption, as well as a $\mathcal{P}$-uniform law of the iterated logarithm.

Statistics Theory,Methodology
Distribution Generated by a Random Inhomogenous Fibonacci Sequence

Kálmán Liptai,László Szalay

DOI: https://doi.org/10.1007/s00009-023-02563-3

2024-01-25

Mediterranean Journal of Mathematics

Abstract:Let and . The present study deals with the inhomogeneous version

mathematics, applied
Random points are good for universal discretization

F. Dai,V. Temlyakov

DOI: https://doi.org/10.1016/j.jmaa.2023.127570

2023-10-12

Abstract:There has been significant progress in the study of sampling discretization of integral norms for both a designated finite-dimensional function space and a finite collection of such function spaces (universal discretization). Sampling discretization results turn out to be very useful in various applications, particularly in sampling recovery. Recent sampling discretization results typically provide existence of good sampling points for discretization. In this paper, we show that independent and identically distributed random points provide good universal discretization with high probability. Furthermore, we demonstrate that a simple greedy algorithm based on those points that are good for universal discretization provides excellent sparse recovery results in the square norm.

Functional Analysis,Classical Analysis and ODEs,Numerical Analysis
A bounded partition approach to identifying one fake coin and its type

Takehiro Tokuda,Yoshimichi Watanabe

2023-06-19

Abstract:Fake coin problems using balance scales to identify one fake coin and its type among n coins (n > 2) were solved by Dyson in 1946. Dyson gave adaptive solutions with the minimum number of weighings where later weighings may be dependent on results of past weighings. In 2003 Born et al. gave non-adaptive solutions where all weighings are predetermined. Both solutions require the computation of a Dyson set, which is a list of placement of each coin for each weighing. The computation of a Dyson set requires substantial amount of time when n gets larger. We present a bounded partition approach to the fake coin problems without computing any Dyson set. Our approach uses bounded partition of coins recursively until the problem size may be small enough to use at most one weighing.

Data Structures and Algorithms,Discrete Mathematics
Variable Bias Coin Tossing

Roger Colbeck,Adrian Kent

DOI: https://doi.org/10.1103/PhysRevA.73.032320

2005-11-23

Abstract:Alice is a charismatic quantum cryptographer who believes her parties are unmissable; Bob is a (relatively) glamorous string theorist who believes he is an indispensable guest. To prevent possibly traumatic collisions of self-perception and reality, their social code requires that decisions about invitation or acceptance be made via a cryptographically secure variable bias coin toss (VBCT). This generates a shared random bit by the toss of a coin whose bias is secretly chosen, within a stipulated range, by one of the parties; the other party learns only the random bit. Thus one party can secretly influence the outcome, while both can save face by blaming any negative decisions on bad luck. We describe here some cryptographic VBCT protocols whose security is guaranteed by quantum theory and the impossibility of superluminal signalling, setting our results in the context of a general discussion of secure two-party computation. We also briefly discuss other cryptographic applications of VBCT.

Quantum Physics,Cryptography and Security
Pseudorandomness, symmetry, smoothing: I

Harm Derksen,Peter Ivanov,Chin Ho Lee,Emanuele Viola

2024-05-22

Abstract:We prove several new results about bounded uniform and small-bias distributions. A main message is that, small-bias, even perturbed with noise, does not fool several classes of tests better than bounded uniformity. We prove this for threshold tests, small-space algorithms, and small-depth circuits. In particular, we obtain small-bias distributions that

Computational Complexity
Choosing 1 of N with and without lucky numbers

Matthew Brand

DOI: https://doi.org/10.48550/arXiv.1808.07994

2018-08-24

Abstract:How many fair coin tosses to choose 1 of $n$ options with uniform probability? Although a probability problem, the solution is essentially number-theoretic, with special roles for Mersenne numbers, Fermat numbers, and the haupt exponent. We propose a bit-efficient scheme, prove optimality, derive the expected number of coin tosses $e[n]$, characterize its fractal structure, and develop sharp upper and lower bounds, both discrete and continuous. A minor but noteworthy corollary, with real-world examples, is that any lottery or simulation with finite budget of random bits will have a predictable pattern of lucky and unlucky numbers.

Number Theory
The distribution of arithmetic functions of general random integers

Emmanuel Kowalski

DOI: https://doi.org/10.48550/arXiv.1909.00965

2019-09-09

Abstract:We consider very general "random integers" and (attempt to) prove that many multiplicative and additive functions of such integers have limiting distributions. These integers include, for instance, the curvatures of Apollonian circle packings, trace of Frobenius elements for elliptic curves, the Ramanujan tau-function, Mersenne numbers, and many others.

Number Theory,Probability

From biased coin to any discrete distribution

Induced Distributions from Generalized Unfair Dice

Optimal Discrete Uniform Generation from Coin Flips, and Applications

A Remark on Sieving in Biased Coin Convolutions

Simulating a die roll by flipping two coins

Locally Sampleable Uniform Symmetric Distributions

Probabilistic vs deterministic gamblers

How to Lose with Least Probability

A new infinitely divisible discrete distribution with applications to count data modeling

Simulating a coin with irrational bias using rational arithmetic

Generalizing the de Finetti--Hewitt--Savage theorem

Fair Coin Flipping: Tighter Analysis and the Many-Party Case

Distribution-uniform anytime-valid sequential inference

Distribution Generated by a Random Inhomogenous Fibonacci Sequence

Random points are good for universal discretization

A bounded partition approach to identifying one fake coin and its type

Variable Bias Coin Tossing

Pseudorandomness, symmetry, smoothing: I

Choosing 1 of N with and without lucky numbers

The distribution of arithmetic functions of general random integers