Benford's Law under Zeckendorf expansion

Sungkon Chang,Steven J. Miller

2023-09-01

Abstract:In the literature, Benford's Law is considered for base-b expansions where b>1 is an integer. In this paper, we investigate the distribution of leading "digits" of a sequence of positive integers under other expansions such as Zeckendorf expansion, and declare what Benford's Law should be under generalized Zeckendorf expansion.

Number Theory

What problem does this paper attempt to address?

A Mathematical Analysis of Benford's Law and its Generalization

Alex E. Kossovsky,Wayne M. Lawton

2023-08-11

Abstract:We explain Kossovsky's generalization of Benford's law which is a formula that approximates the distribution of leftmost digits in finite sequences of natural data and apply it to six sequences of data including populations of US cities and towns and times between earthquakes. We model the natural logarithms of these two data sequences as samples of random variables having normal and reflected Gumbel densities respectively. We show that compliance with the general law depends on how nearly constant the periodized density functions are and that the models are generally more compliant than the natural data. This surprising result suggests that the generalized law might be used to improve density estimation which is the basis of statistical pattern recognition, machine learning and data science.

Methodology,Probability,Statistics Theory,Data Analysis, Statistics and Probability,Applications
Benford Behavior of a Higher-Dimensional Fragmentation Process

Irfan Durmić,Steven J.Miller

2023-08-15

Abstract:Nature and our world have a bias! Roughly $30\%$ of the time the number $1$ occurs as the leading digit in many datasets base $10$. This phenomenon is known as Benford's law and it arrises in diverse fields such as the stock market, optimizing computers, street addresses, Fibonacci numbers, and is often used to detect possible fraud. Based on previous work, we know that different forms of a one-dimensional stick fragmentation result in pieces whose lengths follow Benford's Law. We generalize this result and show that this can be extended to any finite-dimensional ``volume''. We further conjecture that even lower-dimensional volumes, under the unrestricted fragmentation process, follow Benford's Law.

Probability
Benford or not Benford: new results on digits beyond the first

Stéphane Blondeau da Silva

DOI: https://doi.org/10.48550/arXiv.1805.01291

2018-05-02

Abstract:In this paper, we will see that the proportion of d as p th digit, where p > 1 and d $\in$ 0, 9, in data (obtained thanks to the hereunder developed model) is more likely to follow a law whose probability distribution is determined by a specific upper bound, rather than the generalization of Benford's Law to digits beyond the first one. These probability distributions fluctuate around theoretical values determined by Hill in 1995. Knowing beforehand the value of the upper bound can be a way to find a better adjusted law than Hill's one.

Other Statistics,Probability
Significant Digits of Primes in Subsets

Henry Glunz

DOI: https://doi.org/10.48550/arXiv.2207.07204

2022-07-15

Abstract:Benford's Law describes the prevalence of small numbers as the leading digits of numbers in many sets of integers. We prove a variant of Benford's law for many positive-density subsets of the primes. This follows from a more general result over number fields.

Number Theory
Arithmetical Tugs of War and Benford's Law

Alex Ely Kossovsky

DOI: https://doi.org/10.48550/arXiv.1410.2174

2019-01-02

Abstract:Benford's Law predicts that the first significant digit on the leftmost side of numbers in real-life data is proportioned between all possible 1 to 9 digits approximately as in LOG(1 + 1/digit), so that low digits occur much more frequently than high digits in the first place. The two essential prerequisites for data configuration with regards to compliance with Benford's Law are high order of magnitude and positive skewness with a tail falling to the right of the histogram, so that quantitative configuration is such that the small is numerous and the big is rare. A related topic in the study of Benford's Law is the stark contrast between multiplications and additions of random variables and their distinct resultant quantitative and digital configurations. Random multiplication processes induce substantial increase in order of magnitude and they tend to the skewed Lognormal Distribution, favoring the small over the big. Random addition processes on the other hand do not induce any increase in order of magnitude and they tend to the symmetrical Normal Distribution as predicated by the Central Limit Theorem, favoring the medium over the small and the big. Thus, while multiplication processes are highly conducive to Benford behavior, addition processes are highly detrimental to Benford behavior. In this article it is shown that often in real-life data, multiplication and addition processes mix together within one measurement or expression, and consequently they fiercely compete for dominance, each attempting to exert the greatest influence upon sizes and digits. Such tugs of war between additions and multiplications are won or lost depending on the orders of magnitude of the generating random variables, as well as on the relative strength of the two warring sides, measured in terms of the comparative arithmetical involvement in the algebraic expression of the process.

Statistics Theory
Benford-Newcomb Subsequences for Fraud Detection

Aaron Carl Smith

DOI: https://doi.org/10.48550/arXiv.1301.6086

2013-01-22

Abstract:Benford's law is frequently used to evaluate the likihood that data is misrepresentative. Typically statistical tests measure the likihood. Another method of employing Benford's law is to compare the frequency of leading digits to the probabilities of leading digits over a subset of the natural numbers. This paper proposes using the probabilities of leading digits from uniform, natural numbers to establish interval criteria for when to look more closely into the possibility of misrepresentative data.

Statistics Theory
Benford's Law and Continuous Dependent Random Variables

Thealexa Becker,David Burt,Taylor C. Corcoran,Alec Greaves-Tunnell,Joseph R. Iafrate,Joy Jing,Steven J. Miller,Jaclyn D. Porfilio,Ryan Ronan,Jirapat Samranvedhya,Frederick W. Strauch,Blaine Talbut

DOI: https://doi.org/10.1016/j.aop.2017.11.013

2018-03-09

Abstract:Many mathematical, man-made and natural systems exhibit a leading-digit bias, where a first digit (base 10) of 1 occurs not 11\% of the time, as one would expect if all digits were equally likely, but rather 30\%. This phenomenon is known as Benford's Law. Analyzing which datasets adhere to Benford's Law and how quickly Benford behavior sets in are the two most important problems in the field. Most previous work studied systems of independent random variables, and relied on the independence in their analyses. Inspired by natural processes such as particle decay, we study the dependent random variables that emerge from models of decomposition of conserved quantities. We prove that in many instances the distribution of lengths of the resulting pieces converges to Benford behavior as the number of divisions grow, and give several conjectures for other fragmentation processes. The main difficulty is that the resulting random variables are dependent. We handle this by using tools from Fourier analysis and irrationality exponents to obtain quantified convergence rates as well as introducing and developing techniques to measure and control the dependencies. The construction of these tools is one of the major motivations of this work, as our approach can be applied to many other dependent systems. As an example, we show that the $n!$ entries in the determinant expansions of $n\times n$ matrices with entries independently drawn from nice random variables converges to Benford's Law.

Probability
First digit law from Laplace transform

Mingshu Cong,Congqiao Li,Bo-Qiang Ma

DOI: https://doi.org/10.1016/j.physleta.2019.03.017

2019-05-01

Abstract:The occurrence of digits 1 through 9 as the leftmost nonzero digit of numbers from real-world sources is distributed unevenly according to an empirical law, known as Benford's law or the first digit law. It remains obscure why a variety of data sets generated from quite different dynamics obey this particular law. We perform a study of Benford's law from the application of the Laplace transform, and find that the logarithmic Laplace spectrum of the digital indicator function can be approximately taken as a constant. This particular constant, being exactly the Benford term, explains the prevalence of Benford's law. The slight variation from the Benford term leads to deviations from Benford's law for distributions which oscillate violently in the inverse Laplace space. We prove that the whole family of completely monotonic distributions can satisfy Benford's law within a small bound. Our study suggests that Benford's law originates from the way that we write numbers, thus should be taken as a basic mathematical knowledge.

Other Statistics,Statistics Theory,Data Analysis, Statistics and Probability
A concise proof of Benford's law

Luohan Wang,Bo-Qiang Ma

DOI: https://doi.org/10.1016/j.fmre.2023.01.002

2024-08-06

Abstract:This article presents a concise proof of the famous Benford's law when the distribution has a Riemann integrable probability density function and provides a criterion to judge whether a distribution obeys the law. The proof is intuitive and elegant, accessible to anyone with basic knowledge of calculus, revealing that the law originates from the basic property of the human number system. The criterion can bring great convenience to the field of fraud detection.

Statistics Theory,Probability,Other Statistics
Benford's Law: Textbook Exercises and Multiple-choice Testbanks

Aaron D. Slepkov,Kevin B. Ironside,David DiBattista

DOI: https://doi.org/10.48550/arXiv.1311.4787

2013-11-19

Abstract:Benford's Law describes the finding that the distribution of leading (or leftmost) digits of innumerable datasets follows a well-defined logarithmic trend, rather than an intuitive uniformity. In practice this means that the most common leading digit is 1, with an expected frequency of 30.1%, and the least common is 9, with an expected frequency of 4.6%. The history and development of Benford's Law is inexorably linked to physics, yet there has been a dearth of physics-related Benford datasets reported in the literature. Currently, the most common application of Benford's Law is in detecting number invention and tampering such as found in accounting-, tax-, and voter-fraud. We demonstrate that answers to end-of-chapter exercises in physics and chemistry textbooks conform to Benford's Law. Subsequently, we investigate whether this fact can be used to gain advantage over random guessing in multiple-choice tests, and find that while testbank answers in introductory physics closely conform to Benford's Law, the testbank is nonetheless secure against such a Benford's attack for banal reasons.

Data Analysis, Statistics and Probability,Physics Education,Popular Physics
Prime Numbers, Dirichlet Density, and Benford's Law

Alex Ely Kossovsky

DOI: https://doi.org/10.48550/arXiv.1603.08501

2016-03-08

Abstract:The Prime Numbers are well-known for their paradoxical stand regarding Benford's Law. On one hand they adamantly refuse to obey the law of Benford in the usual sense, namely that of a normal density of the proportion of primes with d as the leading digit, yet on the other hand, the Dirichlet density for the subset of all primes with d as the leading digit is indeed LOG(1 + 1/d). In this article the superficiality of the Dirichlet density result is demonstrated and explained in terms of other well-known and established results in the discipline of Benford's Law, conceptually concluding that prime numbers cannot be considered Benford at all, in spite of the Dirichlet density result. In addition, a detailed examination of the digital behavior of prime numbers is outlined, showing a distinct digital development pattern, from a slight preference for low digits at the start for small primes, to a complete digital equality for large primes in the limit as the prime number sequence goes to infinity. Finally an exact analytical expression for the density of the logarithms of primes is derived and shown to be always on the rise at the macro level, an observation that is also confirmed empirically.

General Mathematics
O T ] 3 0 A pr 2 01 9 First digit law from Laplace transform

Mingshu Cong,Congqiao Li,Bo-Qiang Ma

2019-01-01

Abstract:The occurrence of digits 1 through 9 as the leftmost nonzero digit of numbers from real-world sources is distributed unevenly according to an empirical law, known as Benford’s law or the first digit law. It remains obscure why a variety of data sets generated from quite different dynamics obey this particular law. We perform a study of Benford’s law from the application of the Laplace transform, and find that the logarithmic Laplace spectrum of the digital indicator function can be approximately taken as a constant. This particular constant, being exactly the Benford term, explains the prevalence of Benford’s law. The slight variation from the Benford term leads to deviations from Benford’s law for distributions which oscillate violently in the inverse Laplace space. We prove that the whole family of completely monotonic distributions can satisfy Benford’s law within a small bound. Our study suggests that Benford’s law originates from the way that we write numbers, thus should be taken as a basic mathematical knowledge.
Continuous Distributions on $(0,\,\infty)$ Giving Benford's Law Exactly

Kazufumi Ozawa

DOI: https://doi.org/10.48550/arXiv.1905.02031

2019-05-03

Abstract:Benford's law is a famous law in statistics which states that the leading digits of random variables in diverse data sets appear not uniformly from 1 to 9; the probability that d (d=1,...,9) appears as a leading digit is given by \log_{10}(1+1/d). This paper shows the existence of a random variable with a smooth probability density on (0,\infty) whose leading digit distribution follows Benford's law exactly. To construct such a distribution the error theory of the trapezoidal rule is used.

Probability
Benford's Law and Β-Decay Half-Lives

Ni Dong-Dong,Wei Lai,Ren Zhong-Zhou

DOI: https://doi.org/10.1088/0253-6102/51/4/25

2009-01-01

Communications in Theoretical Physics

Abstract:The experimental values of 2059 β-decay half-lives are systematically analyzed and investigated. We have found that they are in satisfactory agreement with Benford's law, which states that the frequency of occurrence of each figure, 1–9, as the first significant digit in a surprisingly large number of different data sets follows a logarithmic distribution favoring the smaller ones. Benford's logarithmic distribution of β-decay half-lives can be explained in terms of Newcomb's justification of Benford's law and empirical exponential law of β-decay half-lives. Moreover, we test the calculated values of 6721 β-decay half-lives with the aid of Benford's law. This indicates that Benford's law is useful for theoretical physicists to test their methods for calculating β-decay half-lives.
Benford's Law and the Universe

T. Alexopoulos,S. Leontsinis

DOI: https://doi.org/10.1007/s12036-014-9303-z

2014-09-10

Abstract:Benford's law predicts the occurrence of the $n^{\mathrm{th}}$ digit of numbers in datasets originating from various sources of the world, ranging from financial data to atomic spectra. It is intriguing that although many features of Benford's law have been proven and analysed, it is still not fully mathematically understood. In this paper we investigate the distances of galaxies and stars by comparing the first, second and third significant digit probabilities with Benford's predictions. It is found that the distances of galaxies follow reasonably well the first digit law and the star distances agree very well with the first, second and third significant digit.

Popular Physics,Astrophysics of Galaxies
The Significant Digit Law in Statistical Physics

Lijing Shao,Bo-Qiang Ma

DOI: https://doi.org/10.1016/j.physa.2010.04.021

2010-01-01

Abstract:The occurrence of the nonzero leftmost digit, i.e., 1, 2, ..., 9, of numbers from many real world sources is not uniformly distributed as one might naively expect, but instead, the nature favors smaller ones according to a logarithmic distribution, named Benford's law. We investigate three kinds of widely used physical statistics, i.e., the Boltzmann-Gibbs (BG) distribution, the Fermi-Dirac (FD) distribution, and the Bose-Einstein (BE) distribution, and find that the BG and FD distributions both fluctuate slightly in a periodic manner around the Benford distribution with respect to the temperature of the system, while the BE distribution conforms to it exactly whatever the temperature is. Thus the Benford's law seems to present a general pattern for physical statistics and might be even more fundamental and profound in nature. Furthermore, various elegant properties of Benford's law, especially the mantissa distribution of data sets, are discussed.
Entropy Principle in Direct Derivation of Benford's Law

Oded Kafri

DOI: https://doi.org/10.48550/arXiv.0901.3047

2009-03-08

Abstract:The uneven distribution of digits in numerical data, known as Benford's law, was discovered in 1881. Since then, this law has been shown to be correct in copious numerical data relating to economics, physics and even prime numbers. Although it attracts considerable attention, there is no a priori probabilistic criterion when a data set should or should not obey the law. Here a general criterion is suggested, namely that any file of digits in the Shannon limit (namely, having maximum entropy) has a Benford's law distribution of digits.

Discrete Mathematics,Data Analysis, Statistics and Probability
Benford's law and the C$β$E

Nedialko Bradinoff,Maurice Duits

2023-12-17

Abstract:We study the individual digits for the absolute value of the characteristic polynomial for the Circular $\beta$-Ensemble. We show that, in the large $N$ limit, the first digits obey Benford's Law and the further digits become uniformly distributed. Key to the proofs is a bound on the rate of convergence in total variation norm in the CLT for the logarithm of the absolute value of the characteristic polynomial.

Probability,Mathematical Physics
A Concise Proof of Benford’s Law

Luohan Wang,Bo-Qiang Ma

DOI: https://doi.org/10.1016/j.fmre.2023.01.002

2023-01-01

Fundamental Research

Abstract:This article presents a concise proof of the famous Benford’s law when the distribution has a Riemann integrable probability density function and provides a criterion to judge whether a distribution obeys the law. The proof is intuitive and elegant, accessible to anyone with basic knowledge of calculus, revealing that the law originates from the basic property of human number system. The criterion can bring great convenience to the field of fraud detection.
Thermodynamics of Benford's First Digit Law

Don S. Lemons

DOI: https://doi.org/10.48550/arXiv.1604.05715

2015-06-23

Abstract:Iafrate, Miller, and Strauch [Equipartition and a Distribution for Numbers: A Statistical Model for Benford's Law," <a class="link-https" data-arxiv-id="1503.08259" href="https://arxiv.org/abs/1503.08259">arXiv:1503.08259</a>] construct and test a statistical model for partitioning a conserved quantity. One consequence of their model is Benford's law. This Comment amplifies their work by exploring its thermodynamic consequences.

Data Analysis, Statistics and Probability

Benford's Law under Zeckendorf expansion

A Mathematical Analysis of Benford's Law and its Generalization

Benford Behavior of a Higher-Dimensional Fragmentation Process

Benford or not Benford: new results on digits beyond the first

Significant Digits of Primes in Subsets

Arithmetical Tugs of War and Benford's Law

Benford-Newcomb Subsequences for Fraud Detection

Benford's Law and Continuous Dependent Random Variables

First digit law from Laplace transform

A concise proof of Benford's law

Benford's Law: Textbook Exercises and Multiple-choice Testbanks

Prime Numbers, Dirichlet Density, and Benford's Law

O T ] 3 0 A pr 2 01 9 First digit law from Laplace transform

Continuous Distributions on $(0,\,\infty)$ Giving Benford's Law Exactly

Benford's Law and Β-Decay Half-Lives

Benford's Law and the Universe

The Significant Digit Law in Statistical Physics

Entropy Principle in Direct Derivation of Benford's Law

Benford's law and the C$β$E

A Concise Proof of Benford’s Law

Thermodynamics of Benford's First Digit Law