Intrinsic simplicity of complex systems

Jianxi Gao

DOI: https://doi.org/10.1038/s41567-023-02268-0

IF: 19.684

2024-01-11

Nature Physics

Abstract:Predicting the large-scale behaviour of complex systems is challenging because of their underlying nonlinear dynamics. Theoretical evidence now verifies that many complex systems can be simplified and still provide an insightful description of the phenomena of interest.

physics, multidisciplinary

What problem does this paper attempt to address?

Simplicity science

Matteo Marsili

DOI: https://doi.org/10.1007/s12648-024-03068-9

2024-02-03

Indian Journal of Physics

Abstract:In recent years, massive amount of data have been made available on a variety of systems, from biology and neuroscience to economics and social sciences. This, and increasing computational power, has led to a surge of approaches based on large computational models, which are particularly suited in the absence of knowledge on the underlying "laws of motion" of such complex systems. I will argue that approaches aimed at extracting simple models or principles from complex systems or from large datasets are still possible. These rely on advances in our understanding of collective phenomena that provide a wealth of powerful methods to distill simple models from complex phenomena. Furthermore, information theory, considered as a universal language for describing complex systems, provides simple principles that can be used both in modelling and in inference from large datasets.

physics, multidisciplinary
Dynamical Behaviour of a Large Complex System

Jianfeng Feng,Mariya Shcherbina,B. Tirozzi

DOI: https://doi.org/10.3934/cpaa.2008.7.249

2008-01-01

Abstract:Limit theorems for a linear dynamical system with random interactions are established. The theorems enable us to characterize the dynamics of a large complex system in details and assess whether a large complex system is weakly stable or unstable (see Definition 1 below).
Data Based Identification and Prediction of Nonlinear and Complex Dynamical Systems

Wenxu Wang,Ying-Cheng Lai,Celso Grebogi

DOI: https://doi.org/10.1016/j.physrep.2016.06.004

2017-04-28

Abstract:The problem of reconstructing nonlinear and complex dynamical systems from measured data or time series is central to many scientific disciplines including physical, biological, computer, and social sciences, as well as engineering and economics. In this paper, we review the recent advances in this forefront and rapidly evolving field, aiming to cover topics such as compressive sensing (a novel optimization paradigm for sparse-signal reconstruction), noised-induced dynamical mapping, perturbations, reverse engineering, synchronization, inner composition alignment, global silencing, Granger Causality and alternative optimization algorithms. Often, these rely on various concepts from statistical and nonlinear physics such as phase transitions, bifurcation, stabilities, and robustness. The methodologies have the potential to significantly improve our ability to understand a variety of complex dynamical systems ranging from gene regulatory systems to social networks towards the ultimate goal of controlling such systems. Despite recent progress, many challenges remain. A purpose of this Review is then to point out the specific difficulties as they arise from different contexts, so as to stimulate further efforts in this interdisciplinary field.

Data Analysis, Statistics and Probability,Chaotic Dynamics,Physics and Society
Simplicity from complex interactions

Wang, Shaopeng

DOI: https://doi.org/10.1038/s41559-018-0618-z

IF: 19.1

2018-01-01

Nature Ecology & Evolution

Abstract:Several recent theoretical studies develop tools to predict species diversity in large model ecosystems, setting a new benchmark for understanding the mechanism of species coexistence in natural ecosystems.
The low-rank hypothesis of complex systems

Vincent Thibeault,Antoine Allard,Patrick Desrosiers

DOI: https://doi.org/10.1038/s41567-023-02303-0

IF: 19.684

2024-01-11

Nature Physics

Abstract:Complex systems are high-dimensional nonlinear dynamical systems with heterogeneous interactions among their constituents. To make interpretable predictions about their large-scale behaviour, it is typically assumed that these dynamics can be reduced to a few equations involving a low-rank matrix describing the network of interactions. Our Article sheds light on this low-rank hypothesis and questions its validity. Using fundamental theorems on singular-value decomposition, we probe the hypothesis for various random graphs, either by making explicit their low-rank formulation or by demonstrating the exponential decrease of their singular values. We verify the hypothesis for real networks by revealing the rapid decrease of their singular values, which has major consequences for their effective ranks. We then evaluate the impact of the low-rank hypothesis for general dynamical systems on networks through an optimal dimension reduction. This allows us to prove that recurrent neural networks can be exactly reduced, and we can connect the rapidly decreasing singular values of real networks to the dimension reduction error of the nonlinear dynamics they support. Finally, we prove that higher-order interactions naturally emerge from the dimension reduction, thus providing insights into the origin of higher-order interactions in complex systems.

physics, multidisciplinary
Universal Science of Complexity: Consistent Understanding of Ecological, Living and Intelligent System Dynamics

Andrei P. Kirilyuk

DOI: https://doi.org/10.48550/arXiv.0706.3219

2014-05-26

Abstract:A major challenge of interdisciplinary description of complex system behaviour is whether real systems of higher complexity levels can be understood with at least the same degree of objective, "scientific" rigour and universality as "simple" systems of classical, Newtonian science paradigm. The problem is reduced to that of arbitrary, many-body interaction (unsolved in standard theory). Here we review its causally complete solution, the ensuing concept of complexity and applications. The discovered key properties of dynamic multivaluedness and entanglement give rise to a qualitatively new kind of mathematical structure providing the exact version of real system behaviour. The extended mathematics of complexity contains the truly universal definition of dynamic complexity, randomness (chaoticity), classification of all possible dynamic regimes, and the unifying principle of any system dynamics and evolution, the universal symmetry of complexity. Every real system has a non-zero (and actually high) value of unreduced dynamic complexity determining, in particular, "mysterious" behaviour of quantum systems and relativistic effects causally explained now as unified manifestations of complex interaction dynamics. The observed differences between various systems are due to different regimes and levels of their unreduced dynamic complexity. We outline applications of universal concept of dynamic complexity emphasising cases of "truly complex" systems from higher complexity levels (ecological and living systems, brain operation, intelligence and consciousness, autonomic information and communication systems) and show that the urgently needed progress in social and intellectual structure of civilisation inevitably involves qualitative transition to unreduced complexity understanding (we call it "revolution of complexity").

General Physics
Self-Organization of Complex Systems

Maya Paczuski,Per Bak

DOI: https://doi.org/10.48550/arXiv.cond-mat/9906077

1999-06-05

Abstract:The basic laws of physics are simple, so why is the world complex? The theory of self-organized criticality posits that complex behavior in nature emerges from the dynamics of extended, dissipative systems that evolve through a sequence of meta-stable states into a critical state, with long range spatial and temporal correlations. Minor disturbances lead to intermittent events of all sizes. These events organize the system into a complex state that cannot be reduced to a few degrees of freedom. This type of ``punctuated equilibrium'' dynamics has been observed in astrophysical, geophysical, and biological processes, as well as in human social activity.

Statistical Mechanics,Quantitative Biology
Non-hyperbolicity at large scales of a high-dimensional chaotic system

Caroline L. Wormell

DOI: https://doi.org/10.48550/arXiv.2109.08080

2022-02-03

Abstract:The dynamics of many important high-dimensional dynamical systems are both chaotic and complex, meaning that strong reducing hypotheses are required to understand the dynamics. The highly influential chaotic hypothesis of Gallavotti and Cohen states that the large-scale dynamics of high-dimensional systems are effectively uniformly hyperbolic, which implies many felicitous statistical properties. We obtain direct and reliable numerical evidence, contrary to the chaotic hypothesis, of the existence of non-hyperbolic large-scale dynamical structures in a mean-field coupled system. To do this we reduce the system to its thermodynamic limit, which we approximate numerically with a Chebyshev basis transfer operator discretisation. This enables us to obtain a high precision estimate of a homoclinic tangency, implying a failure of uniform hyperbolicity. Robust non-hyperbolic behaviour is expected under perturbation. As a result, the chaotic hypothesis should not be {\it a priori} assumed to hold in all systems, and a better understanding of the domain of its validity is required.

Chaotic Dynamics,Mathematical Physics,Dynamical Systems,Numerical Analysis
Dimensionality Reduction in Stochastic Complex Dynamical Networks

Chengyi Tu,Jianhong Luo,Xuwei Pan

2023-05-05

Abstract:Complex systems are ubiquitous in nature and engineering, but their analysis and control are hampered by their high dimensionality and the influence of various factors on their dynamics. Dimensionality reduction aims to find a low-dimensional representation of the complex system that preserves its essential features and reveals its underlying mechanisms and long-term dynamics. However, most existing methods for dimensionality reduction assume deterministic systems, while many real-world systems exhibit stochasticity. Here, we develop a general analytical framework for dimensionality reduction of stochastic complex dynamical networks that can map a high-dimensional system with stochastic terms to a low-dimensional effective system with a single effective state variable and few effective parameters. The effective parameters are those that determine the network's dynamical behavior and are associated with specific system states. The effective equation is a low-dimensional representation of the original stochastic complex dynamical network that preserves its essential dynamical features. The framework also allows us to analyze the dynamic behavior and potential convergence of the stochastic complex dynamical network by using the standard deviation of the effective equation.

Dynamical Systems
A Generalized Theory of Interactions -- I. The General Problem

Santiago Núñez-Corrales,Eric Jakobsson

2024-03-01

Abstract:Understanding realistic complex systems requires confronting significant conceptual, theoretical and experimental limitations rooted in the persistence of views that originated in the mechanics of simple moving bodies. We define the category of complex multiscale stochastic systems as a useful device for capturing the minimally required complexity of many types of phenomena. In doing so, we provide evidence indicating that determinism, continuity and reversibility can lead to theoretical inadequacies that manifest as intractability, inaccuracies or non-representativeness when applied to complex systems. We take the view that interactions are fundamental and summarize their portrayal across many disciplines. Despite their centrality, interactions remain largely neglected as subjects of research interest of their own. We hypothesize that a generalized theory of interactions may help organize evidence from multiple scientific domains towards a more unified realistic view of systems.

Physics and Society,Statistical Mechanics,Adaptation and Self-Organizing Systems
Computational Complex Dynamics Of The Discrete Lorenz System

Sk Sarif Hassan

DOI: https://doi.org/10.48550/arXiv.1604.02671

2016-03-28

Abstract:The dynamics of the classical Lorenz system is well studied in $1963$ by E. N. Lorenz. Later on, there have been an extensive studies on the classical Lorenz system with the complex variables and the discrete time Lorenz system with real variables. To the best of knowledge of the author, so far there is no study on discrete time Lorenz system in complex variables. In this article, an attempt has been made to observe and understand the discrete dynamics of the Lorenz system with complex variables. This study compares the discrete dynamics of the Lorenz system with complex variables to that of the classical Lorenz system involving real and complex variables.

Dynamical Systems
Highly Nonlinear Complexity Of Interaction Dynamics In Scale-Free Networks

Shaoting Tang,Xin Jiang,Sen Pei,Zhicong Liu,Li Ma,Zhanli Zhang,Zhiming Zheng

DOI: https://doi.org/10.1142/S0129183111016439

2011-01-01

International Journal of Modern Physics C

Abstract:Interaction dynamics induced by finite-capacity effect is a typical diffusion model on networks. Although several significant properties of it like condensation have been well studied, the origin of its highly nonlinear complexity, influenced by complex structure and interactive behavior, is still missing. Aimed at filling this gap, we propose entropy to quantify the complexity and exhibit its strong dependence on two coupled crucial elements of nodes, the local topology and the finite capacity. Further, the performance of interaction dynamics, efficiency function is also analyzed in terms of entropy rate and relatively promoted through routing strategy arguments supported by maximum entropy theory studies. This will play a crucial role for inference problems emerging in the field of interaction dynamics on complex networks.
Chaos in Small-World Networks

Xin-She Yang

DOI: https://doi.org/10.1103/PhysRevE.63.046206

2010-03-26

Abstract:A nonlinear small-world network model has been presented to investigate the effect of nonlinear interaction and time delay on the dynamic properties of small-world networks. Both numerical simulations and analytical analysis for networks with time delay and nonlinear interaction show chaotic features in the system response when nonlinear interaction is strong enough or the length scale is large enough. In addition, the small-world system may behave very differently on different scales. Time-delay parameter also has a very strong effect on properties such as the critical length and response time of small-world networks.

Disordered Systems and Neural Networks,Adaptation and Self-Organizing Systems,Physics and Society
Nature versus Nurture in Complex and Not-So-Complex Systems

D. L. Stein,C. M. Newman,D.L. Stein,C.M. Newman

DOI: https://doi.org/10.48550/arXiv.1405.7715

2014-05-29

Statistical Mechanics

Abstract:Understanding the dynamical behavior of many-particle systems both in and out of equilibrium is a central issue in both statistical mechanics and complex systems theory. One question involves "nature versus nurture": given a system with a random initial state evolving through a well-defined stochastic dynamics, how much of the information contained in the state at future times depends on the initial condition ("nature") and how much on the dynamical realization ("nurture")? We discuss this question and present both old and new results for low-dimensional Ising spin systems.
Exploring Simplicity Bias in 1D Dynamical Systems

Kamal Dingle,Mohammad Alaskandarani,Boumediene Hamzi,Ard A. Louis

DOI: https://doi.org/10.3390/e26050426

IF: 2.738

2024-05-17

Entropy

Abstract:Arguments inspired by algorithmic information theory predict an inverse relation between the probability and complexity of output patterns in a wide range of input–output maps. This phenomenon is known as simplicity bias. By viewing the parameters of dynamical systems as inputs, and the resulting (digitised) trajectories as outputs, we study simplicity bias in the logistic map, Gauss map, sine map, Bernoulli map, and tent map. We find that the logistic map, Gauss map, and sine map all exhibit simplicity bias upon sampling of map initial values and parameter values, but the Bernoulli map and tent map do not. The simplicity bias upper bound on the output pattern probability is used to make a priori predictions regarding the probability of output patterns. In some cases, the predictions are surprisingly accurate, given that almost no details of the underlying dynamical systems are assumed. More generally, we argue that studying probability–complexity relationships may be a useful tool when studying patterns in dynamical systems.

physics, multidisciplinary
Deciphering Complexity: Machine Learning Insights into Chaotic Dynamical Systems

Lazare Osmanov

2024-08-04

Abstract:We introduce new machine-learning techniques for analyzing chaotic dynamical systems. The primary objectives of the study include the development of a new and simple method for calculating the Lyapunov exponent using only two trajectory data points unlike traditional methods that require an averaging procedure, the exploration of phase transition graphs from regular periodic to chaotic dynamics to identify "almost integrable" trajectories where conserved quantities deviate from whole numbers, and the identification of "integrable regions" within chaotic trajectories. These methods are applied and tested on two dynamical systems: "Two objects moving on a rod" and the "Henon-Heiles" systems.

Chaotic Dynamics,Classical Physics
Complex Dynamics of Real Nanosystems: Fundamental Paradigm for Nanoscience and Nanotechnology

Andrei P. Kirilyuk

DOI: https://doi.org/10.48550/arXiv.physics/0412097

2004-12-16

General Physics

Abstract:Structure and dynamics of real nanosystems emerge from the unreduced solution of the underlying interaction problem. It has the property of dynamic multivaluedness giving genuine dynamic randomness and complexity (physics/9806002, physics/0405063). Chaoticity is irreducibly high in nanoscale systems and underlies exponentially high efficiency of their real, complex-dynamic operation (physics/0211071). Applications include real, dynamically chaotic quantum devices, nano-biotechnology, and genetics.
Discovering governing equations from data: Sparse identification of nonlinear dynamical systems

Steven L. Brunton,Joshua L. Proctor,J. Nathan Kutz

DOI: https://doi.org/10.1073/pnas.1517384113

2015-09-12

Abstract:The ability to discover physical laws and governing equations from data is one of humankind's greatest intellectual achievements. A quantitative understanding of dynamic constraints and balances in nature has facilitated rapid development of knowledge and enabled advanced technological achievements, including aircraft, combustion engines, satellites, and electrical power. In this work, we combine sparsity-promoting techniques and machine learning with nonlinear dynamical systems to discover governing physical equations from measurement data. The only assumption about the structure of the model is that there are only a few important terms that govern the dynamics, so that the equations are sparse in the space of possible functions; this assumption holds for many physical systems. In particular, we use sparse regression to determine the fewest terms in the dynamic governing equations required to accurately represent the data. The resulting models are parsimonious, balancing model complexity with descriptive ability while avoiding overfitting. We demonstrate the algorithm on a wide range of problems, from simple canonical systems, including linear and nonlinear oscillators and the chaotic Lorenz system, to the fluid vortex shedding behind an obstacle. The fluid example illustrates the ability of this method to discover the underlying dynamics of a system that took experts in the community nearly 30 years to resolve. We also show that this method generalizes to parameterized, time-varying, or externally forced systems.

Dynamical Systems
Complexity: The bigger picture

Tamás Vicsek

DOI: https://doi.org/10.1038/418131a

2010-07-01

Abstract:If a concept is not well defined, there are grounds for its abuse. This is particularly true of complexity, an inherently interdisciplinary concept that has penetrated very different fields of intellectual activity from physics to linguistics, but with no underlying, unified theory. Complexity has become a popular buzzword used in the hope of gaining attention or funding -- institutes and research networks associated with complex systems grow like mushrooms. Why and how did it happen that this vague notion has become a central motif in modern science? Is it only a fashion, a kind of sociological phenomenon, or is it a sign of a changing paradigm of our perception of the laws of nature and of the approaches required to understand them? Because virtually every real system is inherently extremely complicated, to say that a system is complex is almost an empty statement - couldn't an Institute of Complex Systems just as well be called an Institute for Almost Everything? Despite these valid concerns, the world is indeed made of many highly interconnected parts over many scales, whose interactions result in a complex behaviour needing separate interpretation for each level. This realization forces us to appreciate that new features emerge as one goes from one scale to another, so it follows that the science of complexity is about revealing the principles governing the ways by which these new properties appear.

General Physics,Popular Physics

Intrinsic simplicity of complex systems

Simplicity science

Dynamical Behaviour of a Large Complex System

Data Based Identification and Prediction of Nonlinear and Complex Dynamical Systems

Simplicity from complex interactions

The low-rank hypothesis of complex systems

Universal Science of Complexity: Consistent Understanding of Ecological, Living and Intelligent System Dynamics

Self-Organization of Complex Systems

Non-hyperbolicity at large scales of a high-dimensional chaotic system

Dimensionality Reduction in Stochastic Complex Dynamical Networks

A Generalized Theory of Interactions -- I. The General Problem

Computational Complex Dynamics Of The Discrete Lorenz System

Highly Nonlinear Complexity Of Interaction Dynamics In Scale-Free Networks

Chaos in Small-World Networks

Nature versus Nurture in Complex and Not-So-Complex Systems

Exploring Simplicity Bias in 1D Dynamical Systems

Deciphering Complexity: Machine Learning Insights into Chaotic Dynamical Systems

Complex Dynamics of Real Nanosystems: Fundamental Paradigm for Nanoscience and Nanotechnology

Discovering governing equations from data: Sparse identification of nonlinear dynamical systems

Complexity: The bigger picture