Abstract:Sparsity is a fundamental characteristic of numerous biological, social, and technological networks. Network connectivity frequently demonstrates sparsity on multiple spatial scales and network inputs may also possess sparse representations in appropriate domains. In this work, we address the role of sparsity for solving inverse problems in networks with nonlinear and time-evolving dynamics. In the context of pulse-coupled integrate-and-fire networks, we demonstrate that nonlinear network dynamics imparts a compressive coding of both network connectivity and inputs provided they possess a sparse structure. This work thereby formulates an efficient sparsity-based framework for solving several classes of inverse problems in nonlinear network dynamics. Driving the network with a small ensemble of random inputs, we derive a mean-field set of underdetermined linear systems relating the network inputs to the corresponding activity of the nodes via the feed-forward connectivity matrix. In reconstructing the network connections, we utilize compressive sensing theory, which facilitates the recovery of sparse solutions to such underdetermined linear systems. Using the reconstructed connectivity matrix, we are capable of accurately recovering detailed network inputs, which may vary in time, distinct from the random input ensemble. This framework underlines the central role of sparsity in information transmission through network dynamics, providing new insight into the structure-function relationship for high-dimensional networks with nonlinear dynamics. Considering the reconstruction of structural connectivity in large networks is a significant and challenging problem in the study of complex networks, we hypothesize that analogous reconstruction methods taking advantage of sparsity may facilitate key advances in the field.

Diversity of information pathways drives sparsity in real-world networks

Diversity of information pathways drives scaling and sparsity in real-world networks

Sparse Connection Density Underlies the Maximal Functional Difference Between Random and Scale-Free Networks

Laplacian paths in complex networks: information core emerges from entropic transitions

On the Diversity of Non-Linear Transient Dynamics in Several Types of Complex Networks

THE ROLE OF SPARSITY IN INVERSE PROBLEMS FOR NETWORKS WITH NONLINEAR DYNAMICS

Information Spreading Dynamics on Adaptive Social Networks

Network bypasses sustain complexity

Statistical physics of complex information dynamics

Modeling the Evolution of Networks as Shrinking Structural Diversity

Scale-Free Loopy Structure is Resistant to Noise in Consensus Dynamics in Complex Networks.

Diversity-induced trivialization and resilience of neural dynamics

Diversity of Social Ties in Scientific Collaboration Networks

How networks shape diversity for better or worse

Information Entropy of Diffusion Processes on Complex Networks

Mapping from Structure to Dynamics: A Unified View of Dynamical Processes on Networks

Diversity Begets Stability in an Evolving Network

Adaptive Diffusion Processes of Time-Varying Local Information on Networks

Statistical Complexity of Heterogeneous Geometric Networks

Dynamical Mean-Field Theory of Complex Systems on Sparse Directed Networks