Daniel Litt's Probability Puzzle

Maura B. Paterson,Douglas R. Stinson

2024-09-12

Abstract:In this expository note, we discuss a ``balls-and-urns'' probability puzzle posed by Daniel Litt.

Combinatorics

What problem does this paper attempt to address?

Note on a Coin Tossing Problem Posed by Daniel Litt

Bruce Levin

2024-09-20

Abstract:We present an analysis of a coin-tossing problem posed by Daniel Litt which has generated some popular interest. We demonstrate a recursive identity which leads to relatively simple formulas for the excess number of wins for one player over the other together with its increments as the number of coin tosses increases.

Combinatorics
A Novel Approach to Probability

Oded Kafri

DOI: https://doi.org/10.48550/arXiv.1606.03696

2015-10-18

Abstract:When P indistinguishable balls are randomly distributed among L distinguishable boxes, and considering the dense system in which P much greater than L, our natural intuition tells us that the box with the average number of balls has the highest probability and that none of boxes are empty; however in reality, the probability of the empty box is always the highest. This fact is with contradistinction to sparse system in which the number of balls is smaller than the number of boxes (i.e. energy distribution in gas) in which the average value has the highest probability. Here we show that when we postulate the requirement that all possible configurations of balls in the boxes have equal probabilities, a realistic "long tail" distribution is obtained. This formalism when applied for sparse systems converges to distributions in which the average is preferred. We calculate some of the distributions resulted from this postulate and obtain most of the known distributions in nature, namely, Zipf law, Benford law, particles energy distributions, and more. Further generalization of this novel approach yields not only much better predictions for election polls, market share distribution among competing companies and so forth, but also a compelling probabilistic explanation for Planck's famous empirical finding that the energy of a photon is hv.

Physics and Society
Overdrawing Urns using Categories of Signed Probabilities

Bart Jacobs,Dario Stein

DOI: https://doi.org/10.4204/EPTCS.397.11

2023-12-14

Abstract:A basic experiment in probability theory is drawing without replacement from an urn filled with multiple balls of different colours. Clearly, it is physically impossible to overdraw, that is, to draw more balls from the urn than it contains. This paper demonstrates that overdrawing does make sense mathematically, once we allow signed distributions with negative probabilities. A new (conservative) extension of the familiar hypergeometric ('draw-and-delete') distribution is introduced that allows draws of arbitrary sizes, including overdraws. The underlying theory makes use of the dual basis functions of the Bernstein polynomials, which play a prominent role in computer graphics. Negative probabilities are treated systematically in the framework of categorical probability and the central role of datastructures such as multisets and monads is emphasised.

Probability,Machine Learning,Logic in Computer Science
From bocce to positivity: some probabilistic linear algebra

Kent E. Morrison

DOI: https://doi.org/10.4169/math.mag.86.2.110

2014-05-13

Abstract:A question in geometric probability about the location of the balls in a game of bocce leads to related questions about the probability that a system of linear equations has a positive solution and the probability that a random zero-sum game favors the row player. Under reasonable assumptions we are able to find these probabilities.

Probability
Uncertain Urn Problems and Ellsberg Experiment

Baoding Liu

DOI: https://doi.org/10.1007/s00500-018-3306-7

IF: 3.732

2018-01-01

Soft Computing

Abstract:The basic urn problem is to determine the probability of drawing one colored ball from an urn with known composition of differently colored balls. If the composition is unknown, then it is called uncertain. This paper designs some uncertain urn problems in order to compare probability theory and uncertainty theory. It is concluded that uncertainty theory is better than probability theory to deal with uncertain urn problems. As a by-product, this paper also solves the choice problem in Ellsberg experiment by chance theory.
A Simple Formal Language for Probabilistic Decision Problems

Elena Di Lavore,Bart Jacobs,Mario Román

2024-10-14

Abstract:Probabilistic puzzles can be confusing, partly because they are formulated in natural languages - full of unclarities and ambiguities - and partly because there is no widely accepted and intuitive formal language to express them. We propose a simple formal language with arrow notation ($\gets$) for sampling from a distribution and with observe statements for conditioning (updating, belief revision). We demonstrate the usefulness of this simple language by solving several famous puzzles from probabilistic decision theory. The operational semantics of our language is expressed via the (finite, discrete) subdistribution monad. Our broader message is that proper formalisation dispels confusion.

Logic in Computer Science
Impugning Randomness, Convincingly

Yuri Gurevich,Grant Olney Passmore

DOI: https://doi.org/10.48550/arXiv.1601.00665

2015-12-31

Abstract:John organized a state lottery and his wife won the main prize. You may feel that the event of her winning wasn't particularly random, but how would you argue that in a fair court of law? Traditional probability theory does not even have the notion of random events. Algorithmic information theory does, but it is not applicable to real-world scenarios like the lottery one. We attempt to rectify that.

Other Statistics
A Lattice of Gambles

Paul Cuff,Thomas Cover,Gowtham Kumar,Lei Zhao

DOI: https://doi.org/10.48550/arXiv.1208.4414

2012-08-22

Abstract:A gambler walks into a hypothetical fair casino with a very real dollar bill, but by the time he leaves he's exchanged the dollar for a random amount of money. What is lost in the process? It may be that the gambler walks out at the end of the day, after a roller-coaster ride of winning and losing, with his dollar still intact, or maybe even with two dollars. But what the gambler loses the moment he places his first bet is position. He exchanges one distribution of money for a distribution of lesser quality, from which he cannot return. Our first discussion in this work connects known results of economic inequality and majorization to the probability theory of gambling and Martingales. We provide a simple proof that fair gambles cannot increase the Lorenz curve, and we also constructively demonstrate that any sequence of non-increasing Lorenz curves corresponds to at least one Martingale. We next consider the efficiency of gambles. If all fair gambles are available then one can move down the lattice of distributions defined by the Lorenz ordering. However, the step from one distribution to the next is not unique. Is there a sense of efficiency with which one can move down the Lorenz stream? One approach would be to minimize the average total volume of money placed on the table. In this case, it turns out that implementing part of the strategy using private randomness can help reduce the need for the casino's randomness, resulting in less money on the table that the casino cannot get its hands on.

Probability,Information Theory
A random journey through the math of gambling

Paolo Bartesaghi

2023-09-04

Abstract:The laws of chance are often subtle and deceptive. This is why games of chance work. People are convinced that they obey seemingly intuitive laws, while the underlying mathematical structure reveals a different and more complex reality. This article is a brief and rigorous journey through the implications that the mathematical laws governing stochastic processes have on gambling. It addresses a specific process, the random walk, and analyze some instances of fair and unfair games by highlighting the fallacy of many of our intuitions and beliefs. The paper gradually moves from the analysis of the random walk properties to a comprehensive description of the ruin problem. The introduction of the idea of transient and persistent states concludes the discussion. Much emphasis is placed on concrete examples and on the numerical values, in particular of the involved probabilities, and the interpretation of the results is always more central than the demonstrative technical details, which are nevertheless available to the reader.

History and Overview,Probability
On cases where Litt's game is fair

Anne-Laure Basdevant,Olivier Hénard,Edouard Maurel-Segala,Arvind Singh

2024-06-29

Abstract:A fair coin is flipped $n$ times, and two finite sequences of heads and tails (words) $A$ and $B$ of the same length are given. Each time the word $A$ appears in the sequence of coin flips, Alice gets a point, and each time the word $B$ appears, Bob gets a point. Who is more likely to win? This puzzle is a slight extension of Litt's game that recently set Twitter abuzz. We show that Litt's game is fair for any value of $n$ and any two words that have the same auto-correlation structure by building up a bijection that exchanges Bob and Alice scores; the fact that the inter-correlation does not come into play in this case may come up as a surprise.

Combinatorics,Probability
Dynamics and Probability in the Toss of a Coin with Symmetric Inhomogeneous Density

Shilun Li

2023-10-04

Abstract:Under investigation in this paper is the dynamics and probability of heads in the toss of a coin with symmetric inhomogeneous density. Such coins are assumed to have diagonal inertia matrix. The rotational motion of the coin is determined by the initial angular momentum and initial position of the coin. We described the dynamic behavior of the unit normal vector and calculated the limiting probability of heads as time goes to infinity with respect to the fixed initial parameters. Our probability formula extends the formula for homogeneous coins by Keller and Diaconis et al.

Probability,Dynamical Systems
Choosing 1 of N with and without lucky numbers

Matthew Brand

DOI: https://doi.org/10.48550/arXiv.1808.07994

2018-08-24

Abstract:How many fair coin tosses to choose 1 of $n$ options with uniform probability? Although a probability problem, the solution is essentially number-theoretic, with special roles for Mersenne numbers, Fermat numbers, and the haupt exponent. We propose a bit-efficient scheme, prove optimality, derive the expected number of coin tosses $e[n]$, characterize its fractal structure, and develop sharp upper and lower bounds, both discrete and continuous. A minor but noteworthy corollary, with real-world examples, is that any lottery or simulation with finite budget of random bits will have a predictable pattern of lucky and unlucky numbers.

Number Theory
Gambler's Ruin? Some Aspects of Coin Tossing

Porter W. Johnson,David Atkinson

DOI: https://doi.org/10.48550/arXiv.1908.09234

2019-08-25

Abstract:What is the average number of tosses needed before a particular sequence of heads and tails turns up? We solve the problem didactically, starting with doubles, finding that a tail, followed by a head, turns up on the average after only four tosses, while six tosses are needed for two successive heads. The method is extended to encompass the triples head-tail-tail and head-head-tail, but head-tail-head and head-head-head are surprisingly more recalcitrant. However, the general case is finally solved by a new algorithm that allows a simple computation that can be done by hand, even for relatively long strings. It is shown that the average number of tosses is always an even integer.

Probability,History and Overview
Drawing with Distance

Bart Jacobs

2024-05-28

Abstract:Drawing (a multiset of) coloured balls from an urn is one of the most basic models in discrete probability theory. Three modes of drawing are commonly distinguished: multinomial (draw-replace), hypergeometric (draw-delete), and Pólya (draw-add). These drawing operations are represented as maps from urns to distributions over multisets of draws. The set of urns is a metric space via the Wasserstein distance. The set of distributions over draws is also a metric space, using Wasserstein-over-Wasserstein. It is shown that these three draw operations are all isometries, that is, they exactly preserve the Wasserstein distances. Further, drawing is studied in the limit, both for large urns and for large draws. First it is shown that, as the urn size increases, the Wasserstein distances go to zero between hypergeometric and multinomial draws, and also between Pólya and multinomial draws. Second, it is shown that, as the draw size increases, the Wasserstein distance goes to zero (in probability) between an urn and (normalised) multinomial draws from the urn. These results are known, but here, they are formulated in a novel manner as limits of Wasserstein distances. We call these two limit results the law of large urns and the law of large draws.

Logic in Computer Science,Probability
A Treatise on Sucker's Bets

Shalosh B. Ekhad,Doron Zeilberger

DOI: https://doi.org/10.48550/arXiv.1710.10344

2017-10-27

Combinatorics

Abstract:In 1970, Statistics giant, Bradley Efron, amazed the world by coming up with a set of four dice, let's call them A,B,C,D, whose faces are marked with [0,0,4,4,4,4], [3,3,3,3,3,3],[2,2,2,2,6,6],[1,1,1,5,5,5] respectively, where die A beats die B, die B beats die C, die C beats die D, but, surprise surprise, die D beats die A! This was an amazing demonstration that "being more likely to win" is not a transitive relation. But that was only one example, and of course, instead of dice, we can use decks of cards, where they are called (by Martin Gardner, who popularized this way back in 1970) , "sucker's bets". Can you find all such examples, with a specified number of decks, and sizes? If you have a computer algebra system (in our case Maple), you sure can! Not only that, we can figure out how likely such sucker bets are, and derive, fully automatically, statistical information!
Against All Odds: When Logic Meets Probability.

Johan van Benthem

DOI: https://doi.org/10.1007/978-3-319-68270-9_12

2017-01-01

Abstract:This paper is a light walk along interfaces between logic and probability, triggered by a chance encounter with Ed Brinksma. It is not a research paper, or a literature survey, but a pointer to issues. I discuss both direct combinations of logic and probability and structured ways in which logic can be seen as a qualitative version of probability theory. I end by sketching a concrete program for classifying qualitative scenarios that would lend themselves to simple logical reasoning methods, but I also acknowledge a challenge: the ‘unreasonable effective of probability’.
How to Answer Questions of the Type: If you toss a coin n times, how likely is HH to show up more than HT?

Shalosh B. Ekhad,Doron Zeilberger

2024-05-22

Abstract:On March 16, 2024, Daniel Litt, in an X-post, proposed the following brainteaser: "Flip a fair coin 100 times. It gives a sequence of heads (H) and tails (T). For each HH in the sequence of flips, Alice gets a point; for each HT, Bob does, so e.g. for the sequence THHHT Alice gets 2 points and Bob gets 1 point. Who is most likely to win?" We show the power of symbolic computation, in particular the (continuous) Almkvist-Zeilberger algorithm, to answer this, and far more general, questions of this kind.

Combinatorics,Probability
Curiosities regarding waiting times in Pólya's urn model

Norbert Henze,Mark P. Holmes

DOI: https://doi.org/10.48550/arXiv.1911.01052

2019-11-04

Probability

Abstract:Consider an urn initially containing $b$ black and $w$ white balls. Select a ball at random and observe its color. If it is black, stop. Otherwise, return the white ball together with another white ball to the urn. Continue selecting at random, each time adding a white ball, until a black ball is selected. Let $T_{b,w}$ denote the number of draws until this happens. Surprisingly, the expectation of $T_{b,w}$ is infinite for the "fair" initial scenario $b =w=1$, but finite if $b=2$ and $w=10^9$. In fact, $\mathbb{E}[T_{b,w}]$ is finite if and only if $b\ge 2$, and the variance of $T_{b,w}$ is finite if and only if $b \ge 3$, regardless of the number $w$ of white balls. These observations extend to higher moments.
Lottery paradox, DNA evidence and other stories: How to accept uncertain statements

Yudi Pawitan

DOI: https://doi.org/10.48550/arXiv.2108.03971

2022-01-18

Abstract:I think we can agree that dealing with uncertainty is not easy. Probability is the main tool for dealing with uncertainty, and we know there are many probability-related puzzles and paradoxes. Here I describe a rather idiosyncratic selection that highlights the problem of accepting uncertain statements. Without going into a formal decision theory, there are simple intuitive rational bases for doing that, for instance based on high probability alone. The lottery paradox shows the logical problem of accepting uncertain statements based on high probability. The DNA evidence story is an example of the use probabilistic reasoning in court, where philosophical differences between the schools of inference -- the frequentist, Bayesian and likelihood schools -- lead to substantial differences in the quantification of evidence.

Other Statistics

Daniel Litt's Probability Puzzle

Note on a Coin Tossing Problem Posed by Daniel Litt

A Novel Approach to Probability

Overdrawing Urns using Categories of Signed Probabilities

From bocce to positivity: some probabilistic linear algebra

Uncertain Urn Problems and Ellsberg Experiment

A Simple Formal Language for Probabilistic Decision Problems

Impugning Randomness, Convincingly

A Lattice of Gambles

A random journey through the math of gambling

On cases where Litt's game is fair

Dynamics and Probability in the Toss of a Coin with Symmetric Inhomogeneous Density

Choosing 1 of N with and without lucky numbers

Gambler's Ruin? Some Aspects of Coin Tossing

Drawing with Distance

A Treatise on Sucker's Bets

Against All Odds: When Logic Meets Probability.

How to Answer Questions of the Type: If you toss a coin n times, how likely is HH to show up more than HT?

Curiosities regarding waiting times in Pólya's urn model

Lottery paradox, DNA evidence and other stories: How to accept uncertain statements