Power laws in physics

James P. Sethna

DOI: https://doi.org/10.1038/s42254-022-00491-x

2022-08-06

Abstract:Getting the most from power-law-type data can be challenging. James Sethna points out some of the pitfalls in studying power laws arising from emergent scale invariance, as well as important opportunities.

Data Analysis, Statistics and Probability,Statistical Mechanics

What problem does this paper attempt to address?

Power-Law Distributions in Empirical Data

Aaron Clauset,Cosma Rohilla Shalizi,M. E. J. Newman

DOI: https://doi.org/10.1137/070710111

IF: 10.2

2009-11-04

SIAM Review

Abstract:Power-law distributions occur in many situations of scientific interest and have significant consequences for our understanding of natural and man-made phenomena. Unfortunately, the detection and characterization of power laws is complicated by the large fluctuations that occur in the tail of the distributionthe part of the distribution representing large but rare eventsand by the difficulty of identifying the range over which power-law behavior holds. Commonly used methods for analyzing power-law data, such as least-squares fitting, can produce substantially inaccurate estimates of parameters for power-law distributions, and even in cases where such methods return accurate answers they are still unsatisfactory because they give no indication of whether the data obey a power law at all. Here we present a principled statistical framework for discerning and quantifying power-law behavior in empirical data. Our approach combines maximum-likelihood fitting methods with goodness-of-fit tests based on the KolmogorovSmirnov (KS) statistic and likelihood ratios. We evaluate the effectiveness of the approach with tests on synthetic data and give critical comparisons to previous approaches. We also apply the proposed methods to twenty-four real-world data sets from a range of different disciplines, each of which has been conjectured to follow a power-law distribution. In some cases we find these conjectures to be consistent with the data, while in others the power law is ruled out.

mathematics, applied
The Truth about Power Laws: Theory and Reality

Xiaojun Zhang,Zheng He,Liwei Zhang,Lez Rayman-Bacchus,Yue Xiao,Shuhui Shen

DOI: https://doi.org/10.48550/arXiv.2105.10372

2021-05-21

Abstract:Consensus about the universality of the power law feature in complex networks is experiencing profound challenges. To shine fresh light on this controversy, we propose a generic theoretical framework in order to examine the power law property. First, we study a class of birth-and-death networks that is ubiquitous in the real world, and calculate its degree distributions. Our results show that the tails of its degree distributions exhibits a distinct power law feature, providing robust theoretical support for the ubiquity of the power law feature. Second, we suggest that in the real world two important factors, network size and node disappearance probability, point to the existence of the power law feature in the observed networks. As network size reduces, or as the probability of node disappearance increases, then the power law feature becomes increasingly difficult to observe. Finally, we suggest that an effective way of detecting the power law property is to observe the asymptotic (limiting) behaviour of the degree distribution within its effective intervals.

Physics and Society,Adaptation and Self-Organizing Systems
Power-law Energy Level Spacing Distributions in Fractals

Askar A. Iliasov,Mikhail I. Katsnelson,Shengjun Yuan

DOI: https://doi.org/10.1103/physrevb.99.075402

2019-01-01

Abstract:In this article we investigate the energy spectrum statistics of fractals at the quantum level. We show that the energy-level distribution of a fractal follows a power-law behaviour, if its energy spectrum is a limit set of piece-wise linear functions. We propose that such a behaviour is a general feature of fractals, which can not be described properly by random matrix theory. Several other arguments for the power-law behaviour of the energy level-spacing distributions are proposed.
Power-law distributions in binned empirical data

Yogesh Virkar,Aaron Clauset

DOI: https://doi.org/10.1214/13-AOAS710

2014-04-14

Abstract:Many man-made and natural phenomena, including the intensity of earthquakes, population of cities and size of international wars, are believed to follow power-law distributions. The accurate identification of power-law patterns has significant consequences for correctly understanding and modeling complex systems. However, statistical evidence for or against the power-law hypothesis is complicated by large fluctuations in the empirical distribution's tail, and these are worsened when information is lost from binning the data. We adapt the statistically principled framework for testing the power-law hypothesis, developed by Clauset, Shalizi and Newman, to the case of binned data. This approach includes maximum-likelihood fitting, a hypothesis test based on the Kolmogorov--Smirnov goodness-of-fit statistic and likelihood ratio tests for comparing against alternative explanations. We evaluate the effectiveness of these methods on synthetic binned data with known structure, quantify the loss of statistical power due to binning, and apply the methods to twelve real-world binned data sets with heavy-tailed patterns.

Data Analysis, Statistics and Probability,Physics and Society,Applications,Methodology
Power Law Multi-Scaling of Material Strength

Alexander M. Korsunsky

DOI: https://doi.org/10.48550/arXiv.cond-mat/0508653

2005-08-27

Abstract:Power law is one of the the simplest forms of the relationship between different variables of a system. It leads naturally to the introduction of compound parameters describing physical properties of the system. Often one of the variables of interest is the object dimension, or time. The prevalence of a simple power law over the entire range of dimensions or times can be helpfully interpreted as size or time independence of the corresponding compound physical parameter of the system. However, it is also often found that a simple power law only persists for some extreme values, e.g. for very large and/or small sizes, or very short or long times. Transitions between regimes of different power law asymptotic behaviour are encountered frequently in the description of a wide variety of physical systems. While asymptotic power law behaviour may often be readily predicted, e.g. on dimensional grounds, the evaluation of the relationship between system parameters in the transition range usually requires laborious detailed solution. To obviate this difficulty we introduce, on rather general basis, something we refer to as the merging, or 'knee' function. The function possesses sufficient flexibility to describe transitions of various sharpness. To demonstrate its usefuness, the merging function is applied to a variety of well-known scaling laws in the mechanics and strength of materials and structures.

Materials Science
Some Critical Support for Power Laws and their variations

Pedro Miramontes,Wentian Li,Germinal Cocho

DOI: https://doi.org/10.48550/arXiv.1204.3124

2012-04-14

Abstract:The paper "Critical Truths About Power Laws" (Science, 335, pp665-666) by MPH Stumpf MPH and MA Porter is commented

Adaptation and Self-Organizing Systems,Data Analysis, Statistics and Probability
Statistical Laws in Complex Systems

Eduardo G. Altmann

2024-07-29

Abstract:Statistical laws describe regular patterns observed in diverse scientific domains, ranging from the magnitude of earthquakes (Gutenberg-Richter law) and metabolic rates in organisms (Kleiber's law), to the frequency distribution of words in texts (Zipf's and Herdan-Heaps' laws), and productivity metrics of cities (urban scaling laws). The origins of these laws, their empirical validity, and the insights they provide into underlying systems have been subjects of scientific inquiry for centuries. This monograph provides an unifying approach to the study of statistical laws, critically evaluating their role in the theoretical understanding of complex systems and the different data-analysis methods used to evaluate them. Through a historical review and a unified analysis, we uncover that the persistent controversies on the validity of statistical laws are predominantly rooted not in novel empirical findings but in the discordance among data-analysis techniques, mechanistic models, and the interpretations of statistical laws. Starting with simple examples and progressing to more advanced time-series and statistical methods, this monograph and its accompanying repository provide comprehensive material for researchers interested in analyzing data, testing and comparing different laws, and interpreting results in both existing and new datasets.

Physics and Society,Data Analysis, Statistics and Probability
Power-law ansatz in complex systems: excessive loss of information

Sun-Ting Tsai,Chin-De Chang,Ching-Hao Chang,Meng-Xue Tsai,Nan-Jung Hsu,Tzay-Ming Hong

DOI: https://doi.org/10.1103/PhysRevE.92.062925

2016-01-04

Abstract:The ubiquity of power-law relations in empirical data displays physicists' love of simple laws and uncovering common causes among seemingly unrelated phenomena. However, many reported power laws lack statistical support and mechanistic backings, not to mention discrepancies with real data are often explained away as corrections due to finite size or other variables. We propose a simple experiment and rigorous statistical procedures to look into these issues. Making use of the fact that the occurrence rate and pulse intensity of crumple sound obey power law with an exponent that varies with material, we simulate a complex system with two driving mechanisms by crumpling two different sheets together. The probability function of crumple sound is found to transit from two power-law terms to a {\it bona fide} power law as compaction increases. In addition to showing the vicinity of these two distributions in the phase space, this observation nicely demonstrates the effect of interactions to bring about a subtle change in macroscopic behavior and more information may be retrieved if the data are subject to sorting. Our analyses are based on the Akaike information criterion that is a direct measurement of information loss and emphasizes the need to strike a balance between model simplicity and goodness of fit. As a show of force, the Akaike information criterion also found the Gutenberg-Richter law for earthquakes and the scale-free model for brain functional network, 2-dimensional sand pile, and solar flare intensity to suffer excessive loss of information. They resemble more the crumpled-together ball at low compactions in that there appear to be two driving mechanisms that take turns occurring.

Physics and Society
How Structure Affects Power-Law Behavior

Jing Han,Wei Li

DOI: https://doi.org/10.48550/arXiv.cond-mat/0205259

2002-05-13

Abstract:Complex systems contain a lot of individuals and some interactions between them. The structure of interactions can be modeled to be a network: nodes represent individuals and links to be interaction between two individuals. This paper tries to investigate how structure of interactions in the system will affect the power-law behaviors based on the BS co-evolution model from points of system size, the density of connectivity and the ways of connectivity of the interaction network. The current experiments show that small size, high density of connectivity and random connected way will weaken the power-law distribution.

Condensed Matter
Using a Power Law Distribution to describe Big Data

Vijay Gadepally,Jeremy Kepner

DOI: https://doi.org/10.1109/HPEC.2015.7322459

2015-08-29

Abstract:The gap between data production and user ability to access, compute and produce meaningful results calls for tools that address the challenges associated with big data volume, velocity and variety. One of the key hurdles is the inability to methodically remove expected or uninteresting elements from large data sets. This difficulty often wastes valuable researcher and computational time by expending resources on uninteresting parts of data. Social sensors, or sensors which produce data based on human activity, such as Wikipedia, Twitter, and Facebook have an underlying structure which can be thought of as having a Power Law distribution. Such a distribution implies that few nodes generate large amounts of data. In this article, we propose a technique to take an arbitrary dataset and compute a power law distributed background model that bases its parameters on observed statistics. This model can be used to determine the suitability of using a power law or automatically identify high degree nodes for filtering and can be scaled to work with big data.

Social and Information Networks
Extreme events and power-law distributions from nonlinear quantum dissipation

Wai-Keong Mok

2024-10-09

Abstract:Power-law probability distributions are widely used to model extreme statistical events in complex systems, with applications to a vast array of natural phenomena ranging from earthquakes to stock market crashes to pandemics. We propose the emergence of power-law distributions as a generic feature of quantum systems with strong nonlinear dissipation. We introduce a prototypical family of quantum dynamical systems with nonlinear dissipation, and prove analytically the emergence of power-law tails in the steady state probability distribution for energy. The power law physically originates from the amplification of quantum noise, where the scale of the microscopic fluctuations grows with the energy of the system. Our model predicts a power-law regime with infinite mean energy, which manifests as extreme events and divergences in the measurement statistics. Furthermore, we provide numerical evidence of power-law distributions for a general class of nonlinear dynamics known as quantum Liénard systems. This phenomenon can be potentially harnessed to develop extreme photon sources for novel applications in light-matter interaction and sensing.

Quantum Physics,Adaptation and Self-Organizing Systems,Optics
Power Law in a Bounded Range: Estimating the Lower and Upper Bounds from Sample Data

Huan-Xiang Zhou

2023-03-24

Abstract:Power law distributions are widely observed in chemical physics, geophysics, biology, and beyond. The independent variable x of these distributions has an obligatory lower bound and in many cases also an upper bound. Estimating these bounds from sample data is notoriously difficult, with a recent method involving O(N^3) operations, where N denotes sample size. Here I develop an approach for estimating the lower and upper bounds that involves O(N) operations. The approach centers on calculating the mean values, x_min and x_max, of the smallest x and the largest x in N-point samples. A fit of x_min or x_max as a function of N yields the estimate for the lower or upper bound. Application to synthetic data demonstrates the accuracy and reliability of this approach.

Chemical Physics,Biological Physics,Data Analysis, Statistics and Probability,Geophysics,Biomolecules
Multicanonical distribution and the origin of power laws

G. L. Vasconcelos,D. S. P. Salazar

DOI: https://doi.org/10.48550/arXiv.1208.5624

2012-08-28

Abstract:A multicanonical formalism is applied to the problem of statistical equilibrium in a complex system with a hierarchy of dynamical structures. At the small scales the system is in quasi-equilibrium and follows a Maxwell-Boltzmann distribution with a slowly fluctuating temperature. The probability distribution for the temperature is determined using Bayesian analysis and it is then used to average the Maxwell-Boltzmann distribution. The resulting energy distribution law is written in terms of generalized hypergeometric functions, which display power-law tails.

Statistical Mechanics
A complete data frame work for fitting power law distributions

Colin S. Gillespie

DOI: https://doi.org/10.48550/arXiv.1408.1554

2014-08-25

Abstract:Over the last few decades power law distributions have been suggested as forming generative mechanisms in a variety of disparate fields, such as, astrophysics, criminology and database curation. However, fitting these heavy tailed distributions requires care, especially since the power law behaviour may only be present in the distributional tail. Current state of the art methods for fitting these models rely on estimating the cut-off parameter $x_{\min}$. This results in the majority of collected data being discarded. This paper provides an alternative, principled approached for fitting heavy tailed distributions. By directly modelling the deviation from the power law distribution, we can fit and compare a variety of competing models in a single unified framework.

Computation,Physics and Society
Where do power laws come from?

Joshua N. Cooper,Lincoln Lu

DOI: https://doi.org/10.48550/arXiv.math/0702463

2007-02-16

Abstract:What distribution of graphical degree sequence is invariant under ``scaling''? Are these graphs always power-law graphs? We show the answer is a surprising ``yes'' for sparse graphs if we ignore isolated vertices, or more generally, the vertices with degrees less than a fixed constant $k$. We obtain a concentration result on the degree sequence of a random induced subgraph. The case of hypergraphs (or set-systems) is also examined.

Combinatorics
Statistical Patterns in the Equations of Physics and the Emergence of a Meta-Law of Nature

Andrei Constantin,Deaglan Bartlett,Harry Desmond,Pedro G. Ferreira

2024-08-13

Abstract:Physics, as a fundamental science, aims to understand the laws of Nature and describe them in mathematical equations. While the physical reality manifests itself in a wide range of phenomena with varying levels of complexity, the equations that describe them display certain statistical regularities and patterns, which we begin to explore here. By drawing inspiration from linguistics, where Zipf's law states that the frequency of any word in a large corpus of text is roughly inversely proportional to its rank in the frequency table, we investigate whether similar patterns for the distribution of operators emerge in the equations of physics. We analyse three corpora of formulae and find, using sophisticated implicit-likelihood methods, that the frequency of operators as a function of their rank in the frequency table is best described by an exponential law with a stable exponent, in contrast with Zipf's inverse power-law. Understanding the underlying reasons behind this statistical pattern may shed light on Nature's modus operandi or reveal recurrent patterns in physicists' attempts to formalise the laws of Nature. It may also provide crucial input for symbolic regression, potentially augmenting language models to generate symbolic models for physical phenomena. By pioneering the study of statistical regularities in the equations of physics, our results open the door for a meta-law of Nature, a (probabilistic) law that all physical laws obey.

Physics and Society,Computation and Language,High Energy Physics - Theory,Data Analysis, Statistics and Probability,History and Philosophy of Physics
Taylor's power law: before and after 50 years of scientific scrutiny

Meng Xu

DOI: https://doi.org/10.48550/arXiv.1505.02033

2016-04-17

Abstract:Taylor's power law is one of the mostly widely known empirical patterns in ecology discovered in the 20th century. It states that the variance of species population density scales as a power-law function of the mean population density. Taylor's power law was named after the British ecologist Lionel Roy Taylor. During the past half-century, Taylor's power law was confirmed for thousands of biological species and even for non-biological quantities. Numerous theories and models have been proposed to explain the mechanisms of Taylor's power law. However an understanding of the historical origin of this ubiquitous scaling pattern is lacking. This work reviews two research aspects that are fundamental to the discovery of Taylor's power law and provides an outlook of its future studies.

Other Quantitative Biology
On possible origins of power-law distributions

Grzegorz Wilk,Zbigniew Włodarczyk

DOI: https://doi.org/10.1063/1.4825641

2013-09-16

Abstract:Selected examples of possible origins of power-law distributions are presented.

Statistical Mechanics,High Energy Physics - Phenomenology
Power Law Distributions in Class Relationships

Richard Wheeldon,Steve Counsell

DOI: https://doi.org/10.48550/arXiv.cs/0305037

2003-05-20

Software Engineering

Abstract:Power law distributions have been found in many natural and social phenomena, and more recently in the source code and run-time characteristics of Object-Oriented (OO) systems. A power law implies that small values are extremely common, whereas large values are extremely rare. In this paper, we identify twelve new power laws relating to the static graph structures of Java programs. The graph structures analyzed represented different forms of OO coupling, namely, inheritance, aggregation, interface, parameter type and return type. Identification of these new laws provide the basis for predicting likely features of classes in future developments. The research in this paper ties together work in object-based coupling and World Wide Web structures.
Power Law in Sparsified Deep Neural Networks

Lu Hou,James T. Kwok

DOI: https://doi.org/10.48550/arXiv.1805.01891

IF: 5.414

2018-05-04

Machine Learning

Abstract:The power law has been observed in the degree distributions of many biological neural networks. Sparse deep neural networks, which learn an economical representation from the data, resemble biological neural networks in many ways. In this paper, we study if these artificial networks also exhibit properties of the power law. Experimental results on two popular deep learning models, namely, multilayer perceptrons and convolutional neural networks, are affirmative. The power law is also naturally related to preferential attachment. To study the dynamical properties of deep networks in continual learning, we propose an internal preferential attachment model to explain how the network topology evolves. Experimental results show that with the arrival of a new task, the new connections made follow this preferential attachment process.

Power laws in physics

Power-Law Distributions in Empirical Data

The Truth about Power Laws: Theory and Reality

Power-law Energy Level Spacing Distributions in Fractals

Power-law distributions in binned empirical data

Power Law Multi-Scaling of Material Strength

Some Critical Support for Power Laws and their variations

Statistical Laws in Complex Systems

Power-law ansatz in complex systems: excessive loss of information

How Structure Affects Power-Law Behavior

Using a Power Law Distribution to describe Big Data

Extreme events and power-law distributions from nonlinear quantum dissipation

Power Law in a Bounded Range: Estimating the Lower and Upper Bounds from Sample Data

Multicanonical distribution and the origin of power laws

A complete data frame work for fitting power law distributions

Where do power laws come from?

Statistical Patterns in the Equations of Physics and the Emergence of a Meta-Law of Nature

Taylor's power law: before and after 50 years of scientific scrutiny

On possible origins of power-law distributions

Power Law Distributions in Class Relationships

Power Law in Sparsified Deep Neural Networks