A comparison of susceptibility to five antifungal agents of yeast cultures from burn patients.

J. Still,E. Law,K. Belcher,S. A. Spencer

DOI: https://doi.org/10.1016/0305-4179(95)80002-6

IF: 2.609

1995-05-01

Burns

Abstract:

What problem does this paper attempt to address?

Local predictability and information flow in complex dynamical systems

x san liang

DOI: https://doi.org/10.1016/j.physd.2012.12.011

2013-01-01

Abstract:Predictability is by observation a local notion in complex dynamical systems. Its spatiotemporal structure implies a flow, or transfer in discrete cases, of information that redistributes the local predictability within the state space of concern. Information flow is a fundamental concept in general physics which has applications in a wide variety of disciplines such as neuroscience, material science, atmosphere–ocean science, and turbulence research, to name but a few. In this study, it is rigorously formulated with respect to relative entropy within the framework of a system with many components, each signifying a location or a structure. Given a component, the mechanism governing the evolution of its predictability can be classified into two groups, one due to the component itself, another due to a transfer of information from its peers. A measure of the transfer is rigorously derived, and an explicit expression obtained. This measure possesses a form reminiscent of that we have obtained before with respect to absolute entropy in [X.S. Liang and R. Kleeman, A rigorous formalism of information transfer between dynamical system components, Physica D 227 (2007) 173–182]; in particular, when the system is of dimensionality 2, there is no difference between the formalisms with respect to absolute entropy and relative entropy, except for a minus sign. Properties have been explored and discussed; particularly discussed is the property of asymmetry or causality, which states that information transfer from one component to another carries no hint about the transfer in the other direction, in contrast to the transfer of other quantities such as energy. This formalism has been applied to the study of the scale–scale interaction and information transfer between the first two modes of the truncated Burgers equation. It is found that all 12 transfers are essentially zero or negligible, save for a strong transfer between the sine components from the low-frequency mode to the high-frequency mode. That is to say, the predictability of the high-frequency mode is controlled by the knowledge of the low-frequency mode. This result, though from a highly idealized system, has interesting implications about the dynamical closure problem in turbulence research and atmosphere–ocean science, i.e., the subgrid processes may to some extent be parameterized by the large-scale dynamics. This study can be adopted to investigate the propagation of uncertainties in fluid flows, which has important applications in problems such as atmospheric observing platform design, and may be utilized to identify the route of information flowing within a complex network.
Discrimination universally determines reconstruction of multiplex networks

Wu Mincheng,Chen Jiming,He Shibo,Sun Youxian,Havlin Shlomo,Gao Jianxi

2020-01-01

Abstract: Network reconstruction is fundamental to understanding the dynamical behaviors of the networked systems. Many systems, modeled by multiplex networks with various types of interactions, display an entirely different dynamical behavior compared to the corresponding aggregated network. In many cases, unfortunately, only the aggregated topology and partial observations of the network layers are available, raising an urgent demand for reconstructing multiplex networks. We fill this gap by developing a mathematical and computational tool based on the Expectation-Maximization framework to reconstruct multiplex layer structures. The reconstruction accuracy depends on the various factors, such as partial observation and network characteristics, limiting our ability to predict and allocate observations. Surprisingly, by using a mean-field approximation, we discovered that a discrimination indicator that integrates all these factors universally determines the accuracy of reconstruction. This discovery enables us to design the optimal strategies to allocate the fixed budget for deriving the partial observations, promoting the optimal reconstruction of multiplex networks. To further evaluate the performance of our method, we predict beside structure also dynamical behaviors on the multiplex networks, including percolation, random walk, and spreading processes. Finally, applying our method on empirical multiplex networks drawn from biological, transportation, and social domains, corroborate the theoretical analysis.
The Duality of Entropy/Extropy, and Completion of the Kullback Information Complex

Frank Lad,Giuseppe Sanfilippo,Gianna Agrò

DOI: https://doi.org/10.3390/e20080593

2018-08-09

Abstract:The refinement axiom for entropy has been provocative in providing foundations of information theory, recognised as thoughtworthy in the writings of both Shannon and Jaynes. A resolution to their concerns has been provided recently by the discovery that the entropy measure of a probability distribution has a dual measure, a complementary companion designated as "extropy". We report here the main results that identify this fact, specifying the dual equations and exhibiting some of their structure. The duality extends beyond a simple assessment of entropy, to the formulation of relative entropy and the Kullback symmetric distance between two forecasting distributions. This is defined by the sum of a pair of directed divergences. Examining the defining equation, we notice that this symmetric measure can be generated by two other explicable pairs of functions as well, neither of which is a Bregman divergence. The Kullback information complex is constituted by the symmetric measure of entropy/extropy along with one of each of these three function pairs. It is intimately related to the total logarithmic score of two distinct forecasting distributions for a quantity under consideration, this being a complete proper score. The information complex is isomorphic to the expectations that the two forecasting distributions assess for their achieved scores, each for its own score and for the score achieved by the other. Analysis of the scoring problem exposes a Pareto optimal exchange of the forecasters' scores that both are willing to engage. Both would support its evaluation for assessing the relative quality of the information they provide regarding the observation of an unknown quantity of interest. We present our results without proofs, as these appear in source articles that are referenced. The focus here is on their content, unhindered. The mathematical syntax of probability we employ relies upon the operational subjective constructions of Bruno de Finetti.
Statistical physics of complex information dynamics

Arsham Ghavasieh,Carlo Nicolini,Manlio De Domenico

DOI: https://doi.org/10.1103/PhysRevE.102.052304

2020-10-08

Abstract:The constituents of a complex system exchange information to function properly. Their signalling dynamics often leads to the appearance of emergent phenomena, such as phase transitions and collective behaviors. While information exchange has been widely modeled by means of distinct spreading processes -- such as continuous-time diffusion, random walks, synchronization and consensus -- on top of complex networks, a unified and physically-grounded framework to study information dynamics and gain insights about the macroscopic effects of microscopic interactions, is still eluding us. In this article, we present this framework in terms of a statistical field theory of information dynamics, unifying a range of dynamical processes governing the evolution of information on top of static or time varying structures. We show that information operators form a meaningful statistical ensemble and their superposition defines a density matrix that can be used for the analysis of complex dynamics. As a direct application, we show that the von Neumann entropy of the ensemble can be a measure of the functional diversity of complex systems, defined in terms of the functional differentiation of higher-order interactions among their components. Our results suggest that modularity and hierarchy, two key features of empirical complex systems -- from the human brain to social and urban networks -- play a key role to guarantee functional diversity and, consequently, are favored.

Physics and Society,Disordered Systems and Neural Networks,Statistical Mechanics
Information Theory and Dynamical System Predictability

Richard Kleeman

DOI: https://doi.org/10.3390/e13030612

IF: 2.738

2011-03-07

Entropy

Abstract:Predicting the future state of a turbulent dynamical system such as the atmosphere has been recognized for several decades to be an essentially statistical undertaking. Uncertainties from a variety of sources are magnified by dynamical mechanisms and given sufficient time, compromise any prediction. In the last decade or so this process of uncertainty evolution has been studied using a variety of tools from information theory. These provide both a conceptually general view of the problem as well as a way of probing its non-linearity. Here we review these advances from both a theoretical and practical perspective. Connections with other theoretical areas such as statistical mechanics are emphasized. The importance of obtaining practical results for prediction also guides the development presented.

physics, multidisciplinary
Evolving higher-order synergies reveals a trade-off between stability and information integration capacity in complex systems

Thomas F. Varley,Joshua Bongard

2024-01-27

Abstract:There has recently been an explosion of interest in how "higher-order" structures emerge in complex systems. This "emergent" organization has been found in a variety of natural and artificial systems, although at present the field lacks a unified understanding of what the consequences of higher-order synergies and redundancies are for systems. Typical research treat the presence (or absence) of synergistic information as a dependent variable and report changes in the level of synergy in response to some change in the system. Here, we attempt to flip the script: rather than treating higher-order information as a dependent variable, we use evolutionary optimization to evolve boolean networks with significant higher-order redundancies, synergies, or statistical complexity. We then analyse these evolved populations of networks using established tools for characterizing discrete dynamics: the number of attractors, average transient length, and Derrida coefficient. We also assess the capacity of the systems to integrate information. We find that high-synergy systems are unstable and chaotic, but with a high capacity to integrate information. In contrast, evolved redundant systems are extremely stable, but have negligible capacity to integrate information. Finally, the complex systems that balance integration and segregation (known as Tononi-Sporns-Edelman complexity) show features of both chaosticity and stability, with a greater capacity to integrate information than the redundant systems while being more stable than the random and synergistic systems. We conclude that there may be a fundamental trade-off between the robustness of a systems dynamics and its capacity to integrate information (which inherently requires flexibility and sensitivity), and that certain kinds of complexity naturally balance this trade-off.

Information Theory,Dynamical Systems,Chaotic Dynamics,Cellular Automata and Lattice Gases
Prediction of dynamical systems from time-delayed measurements with self-intersections

Krzysztof Barański,Yonatan Gutman,Adam Śpiewak

DOI: https://doi.org/10.1016/j.matpur.2024.04.001

2024-10-15

Abstract:In the context of predicting the behaviour of chaotic systems, Schroer, Sauer, Ott and Yorke conjectured in 1998 that if a dynamical system defined by a smooth diffeomorphism $T$ of a Riemannian manifold $X$ admits an attractor with a natural measure $\mu$ of information dimension smaller than $k$, then $k$ time-delayed measurements of a one-dimensional observable $h$ are generically sufficient for $\mu$-almost sure prediction of future measurements of $h$. In a previous paper we established this conjecture in the setup of injective Lipschitz transformations $T$ of a compact set $X$ in Euclidean space with an ergodic $T$-invariant Borel probability measure $\mu$. In this paper we prove the conjecture for all (also non-invertible) Lipschitz systems on compact sets with an arbitrary Borel probability measure, and establish an upper bound for the decay rate of the measure of the set of points where the prediction is subpar. This partially confirms a second conjecture by Schroer, Sauer, Ott and Yorke related to empirical prediction algorithms as well as algorithms estimating the dimension and number of required delayed measurements (the so-called embedding dimension) of an observed system. We also prove general time-delay prediction theorems for locally Lipschitz or Hölder systems on Borel sets in Euclidean space.

Dynamical Systems,Mathematical Physics
Functional Dynamical Structures in Complex Systems: an Information-Theoretic Approach

Marco Fiorucci

DOI: https://doi.org/10.48550/arXiv.1703.01878

2017-02-14

Abstract:Understanding the dynamical behavior of complex systems is of exceptional relevance in everyday life, from biology to economy. In order to describe the dynamical organization of complex systems, existing methods require the knowledge of the network topology. By contrast, in this thesis we develop a new method based on Information Theory which does not require any topological knowledge. We introduce the Dynamical Cluster Index to detect those groups of system elements which have strong mutual interactions, named as Relevant Subsets. Among them, we identify those which exchange most information with the rest of the system, thus being the most influential for its dynamics. In order to detect such Functional Dynamical Structures, we introduce another information theoretic measure, called D-index. The experimental results make us confident that our method can be effectively used to study both artificial and natural complex systems.

Adaptation and Self-Organizing Systems
Entropy balance and Information processing in bipartite and non-bipartite composite systems

Richard E. Spinney,Joseph T. Lizier,Mikhail Prokopenko

DOI: https://doi.org/10.48550/arXiv.1712.09715

2017-12-28

Statistical Mechanics

Abstract:Information dynamics is an emerging description of information processing in complex systems which describes systems in terms of intrinsic computation, identifying computational primitives of information storage and transfer. In this paper we make a formal analogy between information dynamics and stochastic thermodynamics which describes the thermal behaviour of small irreversible systems. As stochastic dynamics is increasingly being utilized to quantify the thermodynamics associated with the processing of information we suggest such an analogy is instructive, highlighting that existing thermodynamic quantities can be described solely in terms of extant information theoretic measures related to information processing. In this contribution we construct irreversibility measures in terms of these quantities and relate them to the physical entropy productions that characterise the behaviour of single and composite systems in stochastic thermodynamics illustrating them with simple examples. Moreover, we can apply such a formalism to systems which do not have a bipartite structure. In particular we demonstrate that, given suitable non-bipartite processes, the heat flow in a subsystem can still be identified and one requires the present formalism to recover generalizations of the second law. In these systems residual irreversibility is associated with neither subsystem and this must be included in the these generalised second laws. This opens up the possibility of describing all physical systems in terms of computation allowing us to propose a framework for discussing the reversibility of systems traditionally out of scope of stochastic thermodynamics.
Hidden information and regularities of information dynamics IIR

Vladimir S. Lerner

DOI: https://doi.org/10.48550/arXiv.1207.6563

2012-07-27

Adaptation and Self-Organizing Systems

Abstract:Part 1 has studied the conversion of observed random process with its hidden information to related dynamic process, applying entropy functional measure (EF) of the random process and path functional information measure (IPF) of the dynamic conversion process. The variation principle, satisfying the EF-IPF equivalence along shortest path-trajectory, leads to information dual complementary maxmin-minimax law, which creates mechanism of arising information regularities from stochastic process(Lerner 2012). This Part 2 studies mechanism of cooperation of the observed multiple hidden information process, which follows from the law and produces cooperative structures, concurrently assembling in hierarchical information network (IN) and generating the IN digital genetic code. We analyze the interactive information contributions, information quality, inner time scale, information geometry of the cooperative structures, evaluate curvature of these geometrical forms and their cooperative information complexities. The law information mechanisms operate in information observer. The observer, acting according the law, selects random information, converts it in information dynamics, builds the IN cooperatives, which generate the genetic code.
Symbol Dynamics, Information theory and Complexity of Economic time series

Geoffrey Ducournau

DOI: https://doi.org/10.48550/arXiv.2105.04131

2021-05-10

Statistical Finance

Abstract:We propose to examine the predictability and the complexity characteristics of the Standard&Poor500 dynamics behaviors in a coarse-grained way using the symbolic dynamics method and under the prism of the Information theory through the concept of entropy and uncertainty. We believe that experimental measurement of entropy as a way of examining the complexity of a system is more relevant than more common tests of universality in the transition to chaos because it does not make any prior prejudices on the underlying causes associated with the system dynamics, whether deterministic or stochastic. We regard the studied economic time series as being complex and propose to express it in terms of the amount of information this last is producing on different time scales and according to various scaling parameters.
Information Evolution in Complex Networks

Yang Tian,Guoqi Li,Pei Sun

DOI: https://doi.org/10.1063/5.0096009

2022-04-18

Abstract:Many biological phenomena or social events critically depend on how information evolves in complex networks. However, a general theory to characterize information evolution is yet absent. Consequently, numerous unknowns remain about the mechanisms underlying information evolution. Among these unknowns, a fundamental problem, being a seeming paradox, lies in the coexistence of local randomness, manifested as the stochastic distortion of information content during individual-individual diffusion, and global regularity, illustrated by specific non-random patterns of information content on the network scale. Here, we attempt to formalize information evolution and explain the coexistence of randomness and regularity in complex networks. Applying network dynamics and information theory, we discover that a certain amount of information, determined by the selectivity of networks to the input information, frequently survives from random distortion. Other information will inevitably experience distortion or dissipation, whose speeds are shaped by the diversity of information selectivity in networks. The discovered laws exist irrespective of noise, but the noise accounts for the intensification. We further demonstrate the ubiquity of our discovered laws by analyzing the emergence of neural tuning properties in the primary visual and medial temporal cortices of animal brains and the emergence of extreme opinions in social networks.

Biological Physics,Disordered Systems and Neural Networks,Pattern Formation and Solitons,Neurons and Cognition
Dynamical noise can enhance high-order statistical structure in complex systems

Patricio Orio,Pedro A.M. Mediano,Fernando E. Rosas

2023-05-23

Abstract:Recent research has provided a wealth of evidence highlighting the pivotal role of high-order interdependencies in supporting the information-processing capabilities of distributed complex systems. These findings may suggest that high-order interdependencies constitute a powerful resource that is, however, challenging to harness and can be readily disrupted. In this paper we contest this perspective by demonstrating that high-order interdependencies can not only exhibit robustness to stochastic perturbations, but can in fact be enhanced by them. Using elementary cellular automata as a general testbed, our results unveil the capacity of dynamical noise to enhance the statistical regularities between agents and, intriguingly, even alter the prevailing character of their interdependencies. Furthermore, our results show that these effects are related to the high-order structure of the local rules, which affect the system's susceptibility to noise and characteristic times-scales. These results deepen our understanding of how high-order interdependencies may spontaneously emerge within distributed systems interacting with stochastic environments, thus providing an initial step towards elucidating their origin and function in complex systems like the human brain.

Adaptation and Self-Organizing Systems,Information Theory
Hierarchical dynamics of informational patterns and decision-making

Pablo Varona,Mikhail I. Rabinovich

DOI: https://doi.org/10.1098/rspb.2016.0475

2016-06-15

Proceedings of the Royal Society B: Biological Sciences

Abstract:Traditional studies on the interaction of cognitive functions in healthy and disordered brains have used the analyses of the connectivity of several specialized brain networks—the functional connectome. However, emerging evidence suggests that both brain networks and functional spontaneous brain-wide network communication are intrinsically dynamic. In the light of studies investigating the cooperation between different cognitive functions, we consider here the dynamics of hierarchical networks in cognitive space. We show, using an example of behavioural decision-making based on sequential episodic memory, how the description of metastable pattern dynamics underlying basic cognitive processes helps to understand and predict complex processes like sequential episodic memory recall and competition among decision strategies. The mathematical images of the discussed phenomena in the phase space of the corresponding cognitive model are hierarchical heteroclinic networks. One of the most important features of such networks is the robustness of their dynamics. Different kinds of instabilities of these dynamics can be related to ‘dynamical signatures’ of creativity and different psychiatric disorders. The suggested approach can also be useful for the understanding of the dynamical processes that are the basis of consciousness.
Information decomposition in complex systems via machine learning

Kieran A. Murphy,Dani S. Bassett

2024-03-19

Abstract:One of the fundamental steps toward understanding a complex system is identifying variation at the scale of the system's components that is most relevant to behavior on a macroscopic scale. Mutual information provides a natural means of linking variation across scales of a system due to its independence of functional relationship between observables. However, characterizing the manner in which information is distributed across a set of observables is computationally challenging and generally infeasible beyond a handful of measurements. Here we propose a practical and general methodology that uses machine learning to decompose the information contained in a set of measurements by jointly optimizing a lossy compression of each measurement. Guided by the distributed information bottleneck as a learning objective, the information decomposition identifies the variation in the measurements of the system state most relevant to specified macroscale behavior. We focus our analysis on two paradigmatic complex systems: a Boolean circuit and an amorphous material undergoing plastic deformation. In both examples, the large amount of entropy of the system state is decomposed, bit by bit, in terms of what is most related to macroscale behavior. The identification of meaningful variation in data, with the full generality brought by information theory, is made practical for studying the connection between micro- and macroscale structure in complex systems.

Machine Learning,Soft Condensed Matter,Information Theory,Data Analysis, Statistics and Probability
The Poincaré-Shannon Machine: Statistical Physics and Machine Learning Aspects of Information Cohomology

Pierre Baudot

DOI: https://doi.org/10.3390/e21090881

IF: 2.738

2019-09-10

Entropy

Abstract:Previous works established that entropy is characterized uniquely as the first cohomology class in a topos and described some of its applications to the unsupervised classification of gene expression modules or cell types. These studies raised important questions regarding the statistical meaning of the resulting cohomology of information and its interpretation or consequences with respect to usual data analysis and statistical physics. This paper aims to present the computational methods of information cohomology and to propose its interpretations in terms of statistical physics and machine learning. In order to further underline the cohomological nature of information functions and chain rules, the computation of the cohomology in low degrees is detailed to show more directly that the k multivariate mutual information ( I k ) are ( k - 1 ) -coboundaries. The ( k - 1 ) -cocycles condition corresponds to I k = 0 , which generalizes statistical independence to arbitrary degree k. Hence, the cohomology can be interpreted as quantifying the statistical dependences and the obstruction to factorization. I develop the computationally tractable subcase of simplicial information cohomology represented by entropy H k and information I k landscapes and their respective paths, allowing investigation of Shannon’s information in the multivariate case without the assumptions of independence or of identically distributed variables. I give an interpretation of this cohomology in terms of phase transitions in a model of k-body interactions, holding both for statistical physics without mean field approximations and for data points. The I 1 components define a self-internal energy functional U k and ( - 1 ) k I k , k ≥ 2 components define the contribution to a free energy functional G k (the total correlation) of the k-body interactions. A basic mean field model is developed and computed on genetic data reproducing usual free energy landscapes with phase transition, sustaining the analogy of clustering with condensation. The set of information paths in simplicial structures is in bijection with the symmetric group and random processes, providing a trivial topological expression of the second law of thermodynamics. The local minima of free energy, related to conditional information negativity and conditional independence, characterize a minimum free energy complex. This complex formalizes the minimum free-energy principle in topology, provides a definition of a complex system and characterizes a multiplicity of local minima that quantifies the diversity observed in biology. I give an interpretation of this complex in terms of unsupervised deep learning where the neural network architecture is given by the chain complex and conclude by discussing future supervised applications.

physics, multidisciplinary
Understanding interdependency through complex information sharing

Fernando Rosas,Vasilis Ntranos,Christopher J. Ellison,Sofie Pollin,Marian Verhelst

DOI: https://doi.org/10.3390/e18020038

2015-09-15

Abstract:The interactions between three or more random variables are often nontrivial, poorly understood, and yet, are paramount for future advances in fields such as network information theory, neuroscience, genetics and many others. In this work, we propose to analyze these interactions as different modes of information sharing. Towards this end, we introduce a novel axiomatic framework for decomposing the joint entropy, which characterizes the various ways in which random variables can share information. The key contribution of our framework is to distinguish between interdependencies where the information is shared redundantly, and synergistic interdependencies where the sharing structure exists in the whole but not between the parts. We show that our axioms determine unique formulas for all the terms of the proposed decomposition for a number of cases of interest. Moreover, we show how these results can be applied to several network information theory problems, providing a more intuitive understanding of their fundamental limits.

Information Theory
The Complexity of Sequential Prediction in Dynamical Systems

Vinod Raman,Unique Subedi,Ambuj Tewari

2024-02-10

Abstract:We study the problem of learning to predict the next state of a dynamical system when the underlying evolution function is unknown. Unlike previous work, we place no parametric assumptions on the dynamical system, and study the problem from a learning theory perspective. We define new combinatorial measures and dimensions and show that they quantify the optimal mistake and regret bounds in the realizable and agnostic setting respectively.

Machine Learning
The Poincaré-Boltzmann Machine: from Statistical Physics to Machine Learning and back

Pierre Baudot

DOI: https://doi.org/10.48550/arXiv.1907.06486

2019-07-07

Abstract:This paper presents the computational methods of information cohomology applied to genetic expression in and in the companion paper and proposes its interpretations in terms of statistical physics and machine learning. In order to further underline the Hochschild cohomological nature af information functions and chain rules, following, the computation of the cohomology in low degrees is detailed to show more directly that the $k$ multivariate mutual-informations (I_k) are k-coboundaries. The k-cocycles condition corresponds to I_k=0, generalizing statistical independence. Hence the cohomology quantifies the statistical dependences and the obstruction to factorization. The topological approach allows to investigate information in the multivariate case without the assumptions of independent identically distributed variables and without mean field approximations. We develop the computationally tractable subcase of simplicial information cohomology represented by entropy H_k and information I_k landscapes and their respective paths. The I_1 component defines a self-internal energy U_k, and I_k,k>1 components define the contribution to a free energy G_k (the total correlation) of the k-body interactions. The set of information paths in simplicial structures is in bijection with the symmetric group and random processes, provides a trivial topological expression of the 2nd law of thermodynamic. The local minima of free-energy, related to conditional information negativity, and conditional independence, characterize a minimum free energy complex. This complex formalizes the minimum free-energy principle in topology, provides a definition of a complex system, and characterizes a multiplicity of local minima that quantifies the diversity observed in biology. I give an interpretation of this complex in terms of frustration in glass and of Van Der Walls k-body interactions for data points.

Neurons and Cognition
Instability and Information

Felix Patzelt

DOI: https://doi.org/10.48550/arXiv.1511.03732

2015-11-12

Abstract:Many complex systems exhibit extreme events far more often than expected for a normal distribution. This work examines how self-similar bursts of activity across several orders of magnitude can emerge from first principles in systems that adapt to information. Surprising connections are found between two apparently unrelated research topics: hand-eye coordination in balancing tasks and speculative trading in financial markets. Seemingly paradoxically, locally minimising fluctuations can increase a dynamical system's sensitivity to unpredictable perturbations and thereby facilitate global catastrophes. This general principle is studied in several domain-specific models and in behavioural experiments. It explains many findings in both fields and resolves an apparent antinomy: the coexistence of stabilising control or market efficiency and perpetual instabilities resembling critical phenomena in physical systems.

Physics and Society,Adaptation and Self-Organizing Systems,General Finance

A comparison of susceptibility to five antifungal agents of yeast cultures from burn patients.

Local predictability and information flow in complex dynamical systems

Discrimination universally determines reconstruction of multiplex networks

The Duality of Entropy/Extropy, and Completion of the Kullback Information Complex

Statistical physics of complex information dynamics

Information Theory and Dynamical System Predictability

Evolving higher-order synergies reveals a trade-off between stability and information integration capacity in complex systems

Prediction of dynamical systems from time-delayed measurements with self-intersections

Functional Dynamical Structures in Complex Systems: an Information-Theoretic Approach

Entropy balance and Information processing in bipartite and non-bipartite composite systems

Hidden information and regularities of information dynamics IIR

Symbol Dynamics, Information theory and Complexity of Economic time series

Information Evolution in Complex Networks

Dynamical noise can enhance high-order statistical structure in complex systems

Hierarchical dynamics of informational patterns and decision-making

Information decomposition in complex systems via machine learning

The Poincaré-Shannon Machine: Statistical Physics and Machine Learning Aspects of Information Cohomology

Understanding interdependency through complex information sharing

The Complexity of Sequential Prediction in Dynamical Systems

The Poincaré-Boltzmann Machine: from Statistical Physics to Machine Learning and back

Instability and Information