Abstract:Neural population responses in sensory systems are driven by external physical stimuli. This stimulus-response relationship is typically characterized by receptive fields, which have been estimated by neural system identification approaches. Such models usually requires a large amount of training data, yet, the recording time for animal experiments is limited, giving rise to epistemic uncertainty for the learned neural transfer functions. While deep neural network models have demonstrated excellent power on neural prediction, they usually do not provide the uncertainty of the resulting neural representations and derived statistics, such as the stimuli driving neurons optimally, from in silico experiments. Here, we present a Bayesian system identification approach to predict neural responses to visual stimuli, and explore whether explicitly modeling network weight variability can be beneficial for identifying neural response properties. To this end, we use variational inference to estimate the posterior distribution of each model weight given the training data. Tests with different neural datasets demonstrate that this method can achieve higher or comparable performance on neural prediction, with a much higher data efficiency compared to Monte Carlo dropout methods and traditional models using point estimates of the model parameters. Furthermore, our approach enables to identify response properties with credible intervals and perform statistical test for the learned neural features, which avoid the idiosyncrasy of a single model. Finally, in silico experiments show that our model generates stimuli driving neuronal activity significantly better than traditional models, particularly in the limited-data regime.

System identification using Bayesian neural networks with nonparametric noise models

A Sparse Bayesian Approach to the Identification of Nonlinear State-Space Systems.

Nonlinear system identification using a recurrent network in a Bayesian framework

Probabilistic Neural Transfer Function Estimation with Bayesian System Identification

Bayesian Approaches to Nonlinear Network Reconstruction

System identification under non-negativity constraints

Nonlinear System Identification: Learning while respecting physical models using a sequential Monte Carlo method

Bayesian identification of nonseparable Hamiltonians with multiplicative noise using deep learning and reduced-order modeling

Model error analysis in nonlinear system identification using neural networks (II) - the effect of noise in stochastic dynamical system

Probabilistic Numeric SMC Sampling for Bayesian Nonlinear System Identification in Continuous Time

System-Identification Using A New Dynamic Neural-Network

Bayesian Physics-Informed Neural Networks for Robust System Identification of Power Systems

Dynamical System Identification, Model Selection and Model Uncertainty Quantification by Bayesian Inference

Probabilistic solution of chaotic dynamical system inverse problems using Bayesian Artificial Neural Networks

Time-Variation Nonlinear System Identification Based on Bayesian-Gaussian Neural Network.

Identification of stable models via nonparametric prediction error methods

D-optimal Bayesian Interrogation for Parameter and Noise Identification of Recurrent Neural Networks

Epistemic Uncertainty Quantification in State-Space LPV Model Identification Using Bayesian Neural Networks

Towards Robust Bayesian Estimation for Linear Dynamical Systems

Bayesian topology identification of linear dynamic networks

A Robust and Efficient System Identification Method for a State-Space Model with Heavy-Tailed Process and Measurement Noises.