Abstract:Power-law distributions occur in many situations of scientific interest and have significant consequences for our understanding of natural and man-made phenomena. Unfortunately, the detection and characterization of power laws is complicated by the large fluctuations that occur in the tail of the distributionthe part of the distribution representing large but rare eventsand by the difficulty of identifying the range over which power-law behavior holds. Commonly used methods for analyzing power-law data, such as least-squares fitting, can produce substantially inaccurate estimates of parameters for power-law distributions, and even in cases where such methods return accurate answers they are still unsatisfactory because they give no indication of whether the data obey a power law at all. Here we present a principled statistical framework for discerning and quantifying power-law behavior in empirical data. Our approach combines maximum-likelihood fitting methods with goodness-of-fit tests based on the KolmogorovSmirnov (KS) statistic and likelihood ratios. We evaluate the effectiveness of the approach with tests on synthetic data and give critical comparisons to previous approaches. We also apply the proposed methods to twenty-four real-world data sets from a range of different disciplines, each of which has been conjectured to follow a power-law distribution. In some cases we find these conjectures to be consistent with the data, while in others the power law is ruled out.

Discovering power laws in computer programs

Exploring Regularity in Source Code: Software Science and Zipf's Law

Zipf'S Law Leads to Heaps' Law: Analyzing Their Relation in Finite-Size Systems

Deviation of Zipf's and Heaps' Laws in Human Languages with Limited Dictionary Sizes

Power Law Distributions in Class Relationships

POWER-LAW DISTRIBUTIONS BASED ON EXPONENTIAL DISTRIBUTIONS: LATENT SCALING, SPURIOUS ZIPF'S LAW, AND FRACTAL RABBITS

Big Data and Large Numbers. Interpreting Zipf's Law

Co-occurrence of the Benford-like and Zipf Laws Arising from the Texts Representing Human and Artificial Languages

Zipf's Law, Hierarchical Structure, and Cards-Shuffling Model for Urban Development

Scaling Laws in Human Language

The Truth about Power Laws: Theory and Reality

Existence of Hierarchies and Human's Pursuit of Top Hierarchy Lead to Power Law

The Complexity Nature of Large-Scale Software Systems

Zipf's law, 1/f noise, and fractal hierarchy

Lognormals, Power Laws and Double Power Laws in the Distribution of Frequencies of Harmonic Codewords from Classical Music

Universal emergence of local Zipf's law

Zipf's law, power laws, and maximum entropy

Power-Law Distribution of Human Behaviors in Internet Forums

Statistical Laws in Complex Systems

Power-Law Distributions in Empirical Data

The common patterns of abundance: the log series and Zipf's law