Abstract:In 1953, Shannon proposed the question of quantification of structural information to analyze communication systems. The question has become one of the longest great challenges in information science and computer science. Here, we propose the first metric for structural information. Given a graph G, we define the K-dimensional structural information of G (or structure entropy of G), denoted by H-K (G), to be the minimum overall number of bits required to determine the K-dimensional code of the node that is accessible from random walk in G. The K-dimensional structural information provides the principle for completely detecting the natural or true structure, which consists of the rules, regulations, and orders of the graphs, for fully distinguishing the order from disorder in structured noisy data, and for analyzing communication systems, solving the Shannon's problem and opening up new directions. The K-dimensional structural information is also the first metric of dynamical complexity of networks, measuring the complexity of interactions, communications, operations, and even evolution of networks. The metric satisfies a number of fundamental properties, including additivity, locality, robustness, local and incremental computability, and so on. We establish the fundamental theorems of the one-and two-dimensional structural information of networks, including both lower and upper bounds of the metrics of classic data structures, general graphs, the networks of models, and the networks of natural evolution. We propose algorithms to approximate the K-dimensional structural information of graphs by finding the K-dimensional structure of the graphs that minimizes the K-dimensional structure entropy. We find that the K-dimensional structure entropy minimization is the principle for detecting the natural or true structures in real-world networks. Consequently, our structural information provides the foundation for knowledge discovering from noisy data. We establish a black hole principle by using the two-dimensional structure information of graphs. We propose the natural rank of locally listing algorithms by the structure entropy minimization principle, providing the basis for a next-generation search engine.

Information Asymmetry Flowing in Complex Networks

Modes of Information Flow

The Liang-Kleeman Information Flow: Theory and Applications.

The causal interaction between the subnetworks of a complex network

Information Spreading Dynamics on Adaptive Social Networks

Information Flow Within Stochastic Dynamical Systems.

Study of Information Flow Model Based on Fluid Analogy

Asymptotic Analysis of Inhomogeneous Information-Centric Wireless Networks with Infrastructure Support.

Information Entropy of Diffusion Processes on Complex Networks

Probability-Based Routing Symmetry Metrics.

Information Flow as an Emergent Property of Divergence in Phase-Space

Inferring Information Propagation over Online Social Networks: Edge Asymmetry and Flow Tendency

The Causal Interaction Between Complex Subsystems.

Asymmetry between odd and even node weight in complex networks

Network information flow

Information Evolution in Complex Networks

Causation and Information Flow with Respect to Relative Entropy

Structural Modeling and Characteristics Analysis of Flow Interaction Networks in the Internet

Detecting Information Flow Direction in Multivariate Linear and Nonlinear Models

Asymmetrically Interacting Spreading Dynamics on Complex Layered Networks

Structural Information and Dynamical Complexity of Networks