Abstract:Sparsity is a fundamental characteristic of numerous biological, social, and technological networks. Network connectivity frequently demonstrates sparsity on multiple spatial scales and network inputs may also possess sparse representations in appropriate domains. In this work, we address the role of sparsity for solving inverse problems in networks with nonlinear and time-evolving dynamics. In the context of pulse-coupled integrate-and-fire networks, we demonstrate that nonlinear network dynamics imparts a compressive coding of both network connectivity and inputs provided they possess a sparse structure. This work thereby formulates an efficient sparsity-based framework for solving several classes of inverse problems in nonlinear network dynamics. Driving the network with a small ensemble of random inputs, we derive a mean-field set of underdetermined linear systems relating the network inputs to the corresponding activity of the nodes via the feed-forward connectivity matrix. In reconstructing the network connections, we utilize compressive sensing theory, which facilitates the recovery of sparse solutions to such underdetermined linear systems. Using the reconstructed connectivity matrix, we are capable of accurately recovering detailed network inputs, which may vary in time, distinct from the random input ensemble. This framework underlines the central role of sparsity in information transmission through network dynamics, providing new insight into the structure-function relationship for high-dimensional networks with nonlinear dynamics. Considering the reconstruction of structural connectivity in large networks is a significant and challenging problem in the study of complex networks, we hypothesize that analogous reconstruction methods taking advantage of sparsity may facilitate key advances in the field.

Inferring biological networks by sparse identification of nonlinear dynamics

Model selection for hybrid dynamical systems via sparse regression

Sparse Identification of Nonlinear Dynamics with Side Information (SINDy-SI)

Rapid Bayesian identification of sparse nonlinear dynamics from scarce and noisy data

Identifying Latent Dynamic Components in Biological Systems

Data-driven model discovery and model selection for noisy biological systems

Learning sparse nonlinear dynamics via mixed-integer optimization

An improved sparse identification of nonlinear dynamics with Akaike information criterion and group sparsity

Deep Generative Modeling for Identification of Noisy, Non-Stationary Dynamical Systems

Weak-form modified sparse identification of nonlinear dynamics

Characterization of Biologically Relevant Network Structures form Time-series Data

Enhancing model identification with SINDy via nullcline reconstruction

Iterative Sparse Identification of Nonlinear Dynamics

Sparse identification of nonlinear dynamics in the presence of library and system uncertainty

Causal network inference using biochemical kinetics

Benchmarking sparse system identification with low-dimensional chaos

CINDy: Conditional gradient-based Identification of Non-linear Dynamics -- Noise-robust recovery

A Full Bayesian Approach to Sparse Network Inference Using Heterogeneous Datasets

On Identification of Dynamical Structure Functions: A Sparse Bayesian Learning Approach.

Model-free inference of direct network interactions from nonlinear collective dynamics

THE ROLE OF SPARSITY IN INVERSE PROBLEMS FOR NETWORKS WITH NONLINEAR DYNAMICS