A statistical theory of complex systems

jincan chen,tie liu,zhifu huang,guozhen su

2015-01-01

Abstract: Based on the probability distribution observed in complex systems and an assumption that the probability distributions of complex systems satisfy a new generalized multiplication, it is proved that the statistical theory of complex systems can be established in the analogous extensive framework.

What problem does this paper attempt to address?

Probability Distribution Function of Complex Systems

Jincan Chen,Tie Liu,Zhifu Huang,Guozhen Su

DOI: https://doi.org/10.1142/s0217979218500224

2018-01-01

Abstract:Based on the probability distribution observed in some complex systems and an assumption that the entropies of complex systems satisfy a pseudo additivity, it is expounded that a new probability distribution function is suitable for not only a single complex system but also a coupling complex system, and consequently, a statistical theory of complex systems can be established in the extensive-like framework.
A new approach to almost-sure asymptotic stability of stochastic systems of higher dimension

z l huang,w q zhu

DOI: https://doi.org/10.1016/S0020-7462(01)00059-2

IF: 3.336

2003-01-01

International Journal of Non-Linear Mechanics

Abstract:The almost sure asymptotic stability of higher-dimensional linear stochastic systems and of a special class of nonlinear stochastic systems with homogeneous drift and diffusion coefficients of order one is studied. Based on the well-known Khasminskii's theorem, a new approach for obtaining the regions of almost sure asymptotic stability and instability without evaluating the stationary probability density of the diffusion process defined on unit hypersphere is proposed. Two examples of two and three degree-of-freedom linear stochastic systems are given to illustrate the application and effectiveness of the proposed approach combined with stochastic averaging.
A new expression of the probability distribution in incomplete statistics and fundamental thermodynamic relations

ZhiFu Huang,Bihong Lin,Jincan Chen

DOI: https://doi.org/10.48550/arXiv.cond-mat/0703597

2007-03-23

Abstract:In order to overcome the limitations of the original expression of the probability distribution appearing in literature of Incomplete Statistics, a new expression of the probability distribution is derived, where the Lagrange multiplier %B% introduced here is proved to be identical with that introduced in the second and third choices for the internal energy constraint in Tsallis' statistics and to be just equal to the physical inverse temperature. It is expounded that the probability distribution described by the new expression is invariant through uniform translation of the energy spectrum. Moreover, several fundamental thermodynamic relations are given and the relationship between the new and the original expressions of the probability distribution is discussed.

Statistical Mechanics
Inherent Correlations Between Thermodynamics And Statistical Physics In Extensive And Nonextensive Systems

Zhifu Huang,Congjie Ou,A. Le Mehaute,Qiuping A. Wang,Jincan Chen

DOI: https://doi.org/10.1016/j.physa.2009.03.009

2009-01-01

Abstract:With the help of a general expression of the entropies in extensive and nonextensive systems, some important relations between thermodynamics and statistical mechanics are revealed through the views of thermodynamics and statistical physics. These relations are proved through the MaxEnt approach once again. It is found that for a reversible isothermal process, the information contained in the first and second laws of thermodynamics and the MaxEnt approach is equivalent. Moreover, these relations are used to derive the probability distribution functions in nonextensive and extensive statistics and calculate the generalized forces of some interesting systems. The results obtained are of universal significance. (c) 2009 Elsevier B.V. All rights reserved.
A Basic Problem in the Correlations Between Statistics and Thermodynamics

Congjie Ou,Zhifu Huang,Jincan Chen,A. El Kaabouchi,L. Nivanen,A. Le Mehaute,Qiuping A. Wang

DOI: https://doi.org/10.1016/j.chaos.2008.09.034

2009-01-01

Abstract:By using a functional of probability distributions, several different statistical physics including extensive and nonextensive statistics are unified in a general formalism. It’s shown that the equivalence between the Maxent approach and the relation dU=TdS can be seen from the virtual work principle of mechanics. From dU=TdS, any entropic form which can exists for thermodynamical equilibrium system can be maximized in order to derive the probability distribution functions.
A probabilistic mechanics theory for random dynamics

Qiuping A. Wang

DOI: https://doi.org/10.48550/arXiv.1002.4026

2010-02-21

Statistical Mechanics

Abstract:This is a general description of a probabilistic formalism of mechanics, i.e., an extension of the Newtonian mechanics principles to the systems undergoing random motion. From an analysis of the induction procedure from experimental data to the Newtonian laws, it is shown that the experimental verification of Newton law in a random motion implies a stochastic extension of the virtual work principle and the least action principle, i.e., <dW>=0 and <dA>=0 averaged over all the random paths instead of dW=0 and dA=0 for single path in regular dynamics. A probabilistic mechanics is formulated and applied to thermodynamic system. Several known results, rules and principles can be reproduced and justified from this new point of view. To mention some, we have obtain the entropy variation of the free expansion of gas and heat conduction without considering local equilibrium, and a violation of the Liouville theorem and Poincar\'e recurrence theorem, which allows to relate the entropy production to the work performed by random forces in nonequilibrium process.
Probability Thermodynamics and Probability Quantum Field

Ping Zhang,Wen-Du Li,Tong Liu,Wu-Sheng Dai

DOI: https://doi.org/10.1063/5.0150370

2023-10-24

Abstract:We introduce probability thermodynamics and probability quantum fields. By probability we mean that there is an unknown operator, physical or nonphysical, whose eigenvalues obey a certain statistical distribution. Eigenvalue spectra define spectral functions. Various thermodynamic quantities in thermodynamics and effective actions in quantum field theory are all spectral functions. In the scheme, eigenvalues obey a probability distribution, so a probability distribution determines a family of spectral functions in thermodynamics and quantum field theory. This leads to probability thermodynamics and probability quantum fields determined by a probability distribution. In constructing spectral functions, we encounter a problem. The conventional definition of spectral functions applies only to lower bounded spectra. In our scheme, however, there are two types of spectra: lower bounded spectra, corresponding to the probability distribution with nonnegative random variables, and the lower unbounded spectra, corresponding to probability distributions with negative random variables. To take the lower unbounded spectra into account, we generalize the definition of spectral functions by analytical continuation. In some cases, we encounter divergences. We remove the divergence by a renormalization procedure. Moreover, in virtue of spectral theory in physics, we generalize some concepts in probability theory. For example, the moment-generating function in probability theory does not always exist. We redefine the moment-generating function as the generalized heat kernel introduced in this paper, which makes the concept definable when the definition in probability theory fails. Thermodynamic quantities, vacuum amplitudes, one-loop effective actions, and vacuum energies for various probability distributions are presented.

Statistical Mechanics
Statistical physics of complex information dynamics

Arsham Ghavasieh,Carlo Nicolini,Manlio De Domenico

DOI: https://doi.org/10.1103/PhysRevE.102.052304

2020-10-08

Abstract:The constituents of a complex system exchange information to function properly. Their signalling dynamics often leads to the appearance of emergent phenomena, such as phase transitions and collective behaviors. While information exchange has been widely modeled by means of distinct spreading processes -- such as continuous-time diffusion, random walks, synchronization and consensus -- on top of complex networks, a unified and physically-grounded framework to study information dynamics and gain insights about the macroscopic effects of microscopic interactions, is still eluding us. In this article, we present this framework in terms of a statistical field theory of information dynamics, unifying a range of dynamical processes governing the evolution of information on top of static or time varying structures. We show that information operators form a meaningful statistical ensemble and their superposition defines a density matrix that can be used for the analysis of complex dynamics. As a direct application, we show that the von Neumann entropy of the ensemble can be a measure of the functional diversity of complex systems, defined in terms of the functional differentiation of higher-order interactions among their components. Our results suggest that modularity and hierarchy, two key features of empirical complex systems -- from the human brain to social and urban networks -- play a key role to guarantee functional diversity and, consequently, are favored.

Physics and Society,Disordered Systems and Neural Networks,Statistical Mechanics
Information-theoretic Methods for Estimating Complicated Probability Distributions

Zhi Zong

2006-01-01

Abstract:Preface Chapter 1. Randomness and probability Chapter 2. Inference and statistics Chapter 3. Random numbers and their applications Chapter 4. Approximation and B-spline function Chapter 5. Disorder, entropy and entropy estimation Chapter 6. Estimation of 1-D complicated distributions based on large samples Chapter 7. Estimation of 2-D complicated distributions based on large samples Chapter 8. Estimation of 1-D complicated distribution based on small samples Chapter 9. Estimation of 2-D complicated distribution based on small samples Chapter 10. Estimation of the membership function Chapter 11. Code specifications Bibliography Index
The Principle of Preservation of Probability and the Generalized Density Evolution Equation

Jie Li,Jianbing Chen

DOI: https://doi.org/10.1016/j.strusafe.2006.08.001

IF: 5.712

2006-01-01

Structural Safety

Abstract:The present paper aims to provide a uniform and rigorous theoretical basis for the family of newly developed probability density evolution method. Conservation laws are among the most important features of continuum systems, so is the principle of preservation of probability for stochastic dynamical systems. The classical Liouville equation together with its Dostupov–Pugachev extension is firstly discussed. They could be reasonably thought to hold for stochastic systems where the randomness could be characterized by finite random variables but unfortunately they are unfeasible for practical applications because of analytical and numerical intractability. The generalized density evolution equation in conjunction with its numerical implementation procedure is then discussed with assistance of the formal solution. Comparing the Liouville equation and the generalized density evolution equation finds that the former is essentially based on the state space while the latter is on the ground of substantial particle description. The principle of preservation of probability is accordingly revisited from the two descriptions: the state space description and the random event description. On the clear basis, the generalized density evolution equation is derived once again in a more natural way. Underlying problems open for investigations and practical applications and possible extensions are outlined.
Relativistic Theory of Infinite Statistics Fields

Chao Cao,Yi-Xin Chen,Jian-Long Li

DOI: https://doi.org/10.1103/physrevd.80.125019

2009-01-01

Abstract:Infinite statistics in which all representations of the symmetric group can occur is known as a special case of quon theory. However, the validity of relativistic quon theories is still in doubt. In this paper we prove that there exists a relativistic quantum field theory which allows interactions involving infinite statistics particles. We also give some consistency analysis of this theory such as conservation of statistics and Feynman rules.
The probabilistic world

C. Wetterich

2024-10-25

Abstract:Physics is based on probabilities as fundamental entities of a mathematical description. Expectation values of observables are computed according to the classical statistical rule. The overall probability distribution for one world covers all times. The quantum formalism arises once one focuses on the evolution of the time-local probabilistic information. Wave functions or the density matrix allow the formulation of a general linear evolution law for classical statistics. The quantum formalism for classical statistics is a powerful tool which allows us to implement for generalized Ising models the momentum observable with the associated Fourier representation. The association of operators to observables permits the computation of expectation values in terms of the density matrix by the usual quantum rule. We show that probabilistic cellular automata are quantum systems in a formulation with discrete time steps and real wave functions. With a complex structure the evolution operator for automata can be expressed in terms of a Hamiltonian involving fermionic creation and annihilation operators. The time-local probabilistic information amounts to a subsystem of the overall probabilistic system which is correlated with its environment consisting of the past and future. Such subsystems typically involve probabilistic observables for which only a probability distribution for their possible measurement values is available. Incomplete statistics does not permit to compute classical correlation functions for arbitrary subsystem-observables. Bell's inequalities are not generally applicable.

Quantum Physics,Disordered Systems and Neural Networks,Statistical Mechanics,High Energy Physics - Theory
Microcanonical Foundation for Systems with Power-Law Distributions

Sumiyoshi Abe,and A. K. Rajagopal

DOI: https://doi.org/10.1088/0305-4470/33/48/311

2000-02-11

Abstract:Starting from microcanonical basis with the principle of equal a priori probability, it is found that, besides ordinary Boltzmann-Gibbs theory with the exponential distribution, a theory describing systems with power-law distributions can also be derived.

Statistical Mechanics
Statistical Laws in Complex Systems

Eduardo G. Altmann

2024-07-29

Abstract:Statistical laws describe regular patterns observed in diverse scientific domains, ranging from the magnitude of earthquakes (Gutenberg-Richter law) and metabolic rates in organisms (Kleiber's law), to the frequency distribution of words in texts (Zipf's and Herdan-Heaps' laws), and productivity metrics of cities (urban scaling laws). The origins of these laws, their empirical validity, and the insights they provide into underlying systems have been subjects of scientific inquiry for centuries. This monograph provides an unifying approach to the study of statistical laws, critically evaluating their role in the theoretical understanding of complex systems and the different data-analysis methods used to evaluate them. Through a historical review and a unified analysis, we uncover that the persistent controversies on the validity of statistical laws are predominantly rooted not in novel empirical findings but in the discordance among data-analysis techniques, mechanistic models, and the interpretations of statistical laws. Starting with simple examples and progressing to more advanced time-series and statistical methods, this monograph and its accompanying repository provide comprehensive material for researchers interested in analyzing data, testing and comparing different laws, and interpreting results in both existing and new datasets.

Physics and Society,Data Analysis, Statistics and Probability
Asymptotic Behavior of a Sequence of Conditional Probability Distributions and the Canonical Ensemble

Yu-Chen Cheng,Hong Qian,Yizhe Zhu

DOI: https://doi.org/10.1007/s00023-020-01011-2

2020-12-28

Abstract:The probability distribution of a function of a subsystem conditioned on the value of the function of the whole, in the limit when the ratio of their values goes to zero, has a limit law: It equals the unconditioned marginal probability distribution weighted by an exponential factor whose exponent is uniquely determined by the condition. We apply this theorem to explain the canonical equilibrium ensemble of a system in contact with a heat reservoir. Since the theorem only requires analysis at the level of the function of the subsystem and reservoir, it is applicable even without the knowledge of the composition of the reservoir itself, which extends the applicability of the canonical ensemble. Furthermore, we generalize our theorem to a model with strong interaction that contributes an additional term to the exponent, which is beyond the typical case of approximately additive functions. This result is new in both physics and mathematics, as a theory for the Gibbs conditioning principle for strongly correlated systems. A corollary provides a precise formulation of what a temperature bath is in probabilistic term

Mathematical Physics,Statistical Mechanics,Probability,Data Analysis, Statistics and Probability
Combining lower bounds on entropy production in complex systems with multiple interacting components

David H. Wolpert

DOI: https://doi.org/10.48550/arXiv.2208.02902

2022-08-05

Abstract:The past two decades have seen a revolution in statistical physics, generalizing it to apply to systems of arbitrary size, evolving while arbitrarily far from equilibrium. Many of these new results are based on analyzing the dynamics of the entropy of a system that is evolving according to a Markov process. These results comprise a sub-field called ``stochastic thermodynamics''. Some of the most powerful results in stochastic thermodynamics were traditionally concerned with single, monolithic systems, evolving by themselves, ignoring any internal structure of those systems. In this chapter I review how in complex systems, composed of many interacting constituent systems, it is possible to substantially strengthen many of these traditional results of stochastic thermodynamics. This is done by ``mixing and matching'' those traditional results, to each apply to only a subset of the interacting systems, thereby producing a more powerful result at the level of the aggregate, complex system.

Statistical Mechanics
Generalizing Gibbsian Statistical Ensemble Theory for Strongly Coupled Heterogeneous Systems

Yuchen Cheng,Wenning Wang,Hong Qian

2018-01-01

Abstract:We use the theory of probability to show that, as the fraction $X_n/Y\to 0$, the conditional probability for $X_n$, given $X_n+Y \in h_{\delta}:=[h, h+\delta]$, has a limit law $f_{X_n}(x)e^{-\psi_n(h_\delta)x}$, where $\psi_n(h_\delta) $ equals to $[\partial \ln P(Y \in y_\delta)/\partial y]_{y=h}$ plus an additional term, contributed from the strong correlation between $X_n$ and bath $Y$. Since $\delta$ is infinitesimal, the theory shows a logic equivalence between the conditional probability setup and traditional energy conservation in dynamics. We obtain the state space density for a system strongly coupled to a heat bath. A discrete version of the theorem yields the grand canonical distribution without the Gibbs paradox. In terms of certain invariant criteria with respect to $h_\delta$, the concept of a thermodynamic reservoir is given.
Conditional statistical physical properties in two-joint complex systems having long-range interactions

zhifu huang

2013-01-01

Abstract: We propose the sum and the difference of the normalized velocity of two-joint systems to describe its long-range interaction. It is found that the conditional probability distribution function (CPDF) of the normalized velocity between two-joint systems can be derived. The analytical CPDF needs only six parameters for arbitrary two-joint systems. Two typical currency exchange databases, i.e., EUR/USD and GBP/USD, which collect the minutely opening exchange prices from 1 January 1999 to 31 December 2011, are adopted as example. By calculating the CPDF in the currency exchange databases, it is shown that all of the results are well described by our theory. We also use the analytical CPDF to calculate the entropy of two-joint systems, it is found that the entropy of two-joint systems is less than the sum of entropy of each system in the two currency exchange databases. It means that some information of two-joint systems may overlap. We must important to note that the results presented here do not need to know the form of interaction of two-joint systems, and the analytical CPDF is a general expression. It is valid not only for current exchange systems, but also helpful for investigate other conditional statistical properties in any two-joint long-range interactions complex systems.
Incomplete Nonextensive Statistics and the Zeroth Law of Thermodynamics

Huang Zhi-Fu,Ou Cong-Jie,Chen Jin-Can

DOI: https://doi.org/10.1088/1674-1056/22/4/040501

2013-01-01

Chinese Physics B

Abstract:On the basis of the entropy of incomplete statistics （IS） and the joint probability factorization condition, two controversial problems existing in IS are investigated: one is what expression of the internal energy is reasonable for a composite system and the other is whether the traditional zeroth law of thermodynamics is suitable for IS. Some new equivalent expressions of the internal energy of a composite system are derived through accurate mathematical calculation. Moreover, a self-consistent calculation is used to expound that the zeroth law of thermodynamics is also suitable for IS, but it cannot be proven theoretically. Finally, it is pointed out that the generalized zeroth law of thermodynamics for incomplete nonextensive statistics is unnecessary and the nonextensive assumptions for the composite internal energy will lead to mathematical contradiction.

A statistical theory of complex systems

Probability Distribution Function of Complex Systems

A new approach to almost-sure asymptotic stability of stochastic systems of higher dimension

A new expression of the probability distribution in incomplete statistics and fundamental thermodynamic relations

Inherent Correlations Between Thermodynamics And Statistical Physics In Extensive And Nonextensive Systems

A Basic Problem in the Correlations Between Statistics and Thermodynamics

A probabilistic mechanics theory for random dynamics

Probability Thermodynamics and Probability Quantum Field

Statistical physics of complex information dynamics

Information-theoretic Methods for Estimating Complicated Probability Distributions

The Principle of Preservation of Probability and the Generalized Density Evolution Equation

Relativistic Theory of Infinite Statistics Fields

The probabilistic world

Microcanonical Foundation for Systems with Power-Law Distributions

Statistical Laws in Complex Systems

Asymptotic Behavior of a Sequence of Conditional Probability Distributions and the Canonical Ensemble

Combining lower bounds on entropy production in complex systems with multiple interacting components

Generalizing Gibbsian Statistical Ensemble Theory for Strongly Coupled Heterogeneous Systems

Conditional statistical physical properties in two-joint complex systems having long-range interactions

Incomplete Nonextensive Statistics and the Zeroth Law of Thermodynamics