Abstract:In 1953, Shannon proposed the question of quantification of structural information to analyze communication systems. The question has become one of the longest great challenges in information science and computer science. Here, we propose the first metric for structural information. Given a graph G, we define the K-dimensional structural information of G (or structure entropy of G), denoted by H-K (G), to be the minimum overall number of bits required to determine the K-dimensional code of the node that is accessible from random walk in G. The K-dimensional structural information provides the principle for completely detecting the natural or true structure, which consists of the rules, regulations, and orders of the graphs, for fully distinguishing the order from disorder in structured noisy data, and for analyzing communication systems, solving the Shannon's problem and opening up new directions. The K-dimensional structural information is also the first metric of dynamical complexity of networks, measuring the complexity of interactions, communications, operations, and even evolution of networks. The metric satisfies a number of fundamental properties, including additivity, locality, robustness, local and incremental computability, and so on. We establish the fundamental theorems of the one-and two-dimensional structural information of networks, including both lower and upper bounds of the metrics of classic data structures, general graphs, the networks of models, and the networks of natural evolution. We propose algorithms to approximate the K-dimensional structural information of graphs by finding the K-dimensional structure of the graphs that minimizes the K-dimensional structure entropy. We find that the K-dimensional structure entropy minimization is the principle for detecting the natural or true structures in real-world networks. Consequently, our structural information provides the foundation for knowledge discovering from noisy data. We establish a black hole principle by using the two-dimensional structure information of graphs. We propose the natural rank of locally listing algorithms by the structure entropy minimization principle, providing the basis for a next-generation search engine.

Dynamical Structure Functions for the Estimation of LTI Networks with Limited Information

A Minimal Realization Technique for the Dynamical Structure Function of a Class of LTI Systems.

On Minimal Realisations of Dynamical Structure Functions.

Identifiability and Identification of Switching Dynamical Networks: A Data-Based Approach

On Identification of Dynamical Structure Functions: A Sparse Bayesian Learning Approach.

A Novel Description of Linear Time--Invariant Networks via Structured Coprime Factorizations

Minimal realization of the dynamical structure function and its application to network reconstruction

Structure Reconstruction for Linear Network Systems with Dynamical Structure Functions

Minimal dynamical structure realisations with application to network reconstruction from data

Functional Dynamical Structures in Complex Systems: an Information-Theoretic Approach

Robust Dynamical Network Structure Reconstruction.

Structural Information and Dynamical Complexity of Networks

Structure Identification of Uncertain General Complex Dynamical Networks with Time Delay.

State Estimation for General Complex Dynamical Networks with Incompletely Measured Information.

Dynamical Structure Function and Granger Causality: Similarities and Differences

Network Reconstruction Using Dynamical Structure Functions

Optimization-Based Structure Identification of Dynamical Networks

Data-informativity conditions for structured linear systems with implications for dynamic networks

Distributed Estimation and Control for LTI Systems under Finite-Time Agreement

Universal structural estimator and dynamics approximator for complex networks

Robust Topology Identification and Control of LTI Networks