Abstract:Sparsity is a fundamental characteristic of numerous biological, social, and technological networks. Network connectivity frequently demonstrates sparsity on multiple spatial scales and network inputs may also possess sparse representations in appropriate domains. In this work, we address the role of sparsity for solving inverse problems in networks with nonlinear and time-evolving dynamics. In the context of pulse-coupled integrate-and-fire networks, we demonstrate that nonlinear network dynamics imparts a compressive coding of both network connectivity and inputs provided they possess a sparse structure. This work thereby formulates an efficient sparsity-based framework for solving several classes of inverse problems in nonlinear network dynamics. Driving the network with a small ensemble of random inputs, we derive a mean-field set of underdetermined linear systems relating the network inputs to the corresponding activity of the nodes via the feed-forward connectivity matrix. In reconstructing the network connections, we utilize compressive sensing theory, which facilitates the recovery of sparse solutions to such underdetermined linear systems. Using the reconstructed connectivity matrix, we are capable of accurately recovering detailed network inputs, which may vary in time, distinct from the random input ensemble. This framework underlines the central role of sparsity in information transmission through network dynamics, providing new insight into the structure-function relationship for high-dimensional networks with nonlinear dynamics. Considering the reconstruction of structural connectivity in large networks is a significant and challenging problem in the study of complex networks, we hypothesize that analogous reconstruction methods taking advantage of sparsity may facilitate key advances in the field.

THE ROLE OF SPARSITY IN INVERSE PROBLEMS FOR NETWORKS WITH NONLINEAR DYNAMICS

Compressive Sensing Reconstruction of Feed-Forward Connectivity in Pulse-Coupled Nonlinear Networks.

Reconstruction of sparse recurrent connectivity and inputs from the nonlinear dynamics of neuronal networks

Sparsity and Compressed Coding in Sensory Systems

Network Dynamics for Optimal Compressive-Sensing Input-Signal Recovery.

Compressive Sensing Inference of Neuronal Network Connectivity in Balanced Neuronal Dynamics

Sparse dynamic network reconstruction through L1-regularization of a Lyapunov equation

Sparse Recovery Beyond Compressed Sensing: Separable Nonlinear Inverse Problems

Solving the inverse problem of noise-driven dynamic networks.

Compressed Sensing for Network Reconstruction

Unraveling Low-Dimensional Network Dynamics: A Fusion of Sparse Identification and Proper Orthogonal Decomposition

Depicting Network Structures from Variable Data Produced by Unknown Colored-Noise Driven Dynamics

Inferring biological networks by sparse identification of nonlinear dynamics

Diversity of information pathways drives scaling and sparsity in real-world networks

Distributed Continuous and Discrete Time Projection Neurodynamic Approaches for Sparse Recovery.

Robust Reconstruction of Complex Networks from Sparse Data

Efficient Image Processing Via Compressive Sensing of Integrate-and-fire Neuronal Network Dynamics

Distributed Computation for Sparse Recovery Via Continuous-Time Neurodynamic Approach

Diversity of information pathways drives sparsity in real-world networks

A Sparse Recovery Algorithm Using the Neurodynamic System with Predefined Time Convergence