Abstract:Neurons communicate nonlinearly through spike activities. Generalized linear models (GLMs) describe spike activities with a cascade of a linear combination across inputs, a static nonlinear function, and an inhomogeneous Bernoulli or Poisson process, or Cox process if a self-history term is considered. This structure considers the output nonlinearity in spike generation but excludes the nonlinear interaction among input neurons. Recent studies extend GLMs by modeling the interaction among input neurons with a quadratic function, which considers the interaction between every pair of input spikes. However, quadratic effects may not fully capture the nonlinear nature of input interaction. We therefore propose a staged point-process model to describe the nonlinear interaction among inputs using a few hidden units, which follows the idea of artificial neural networks. The output firing probability conditioned on inputs is formed as a cascade of two linear-nonlinear (a linear combination plus a static nonlinear function) stages and an inhomogeneous Bernoulli process. Parameters of this model are estimated by maximizing the log likelihood on output spike trains. Unlike the iterative reweighted least squares algorithm used in GLMs, where the performance is guaranteed by the concave condition, we propose a modified Levenberg-Marquardt(L-M) algorithm, which directly calculates the Hessian matrix of the log likelihood, for the nonlinear optimization in our model. The proposed model is tested on both synthetic data and real spike train data recorded from the dorsal premotor cortex and primary motor cortex of a monkey performing a center-out task. Performances are evaluated by discrete-time rescaled Kolmogorov-Smirnov tests, where our model statistically outperforms a GLM and its quadratic extension, with a higher goodness-of-fit in the prediction results. In addition, the staged point-process model describes nonlinear interaction among input neurons with fewer parameters than quadratic models, and the modified L-M algorithm also demonstrates fast convergence.

Emergent Inference of Hidden Markov Models in Spiking Neural Networks Through Winner-Take-All.

Winner-Take-All as Basic Probabilistic Inference Unit of Neuronal Circuits

Hierarchical Bayesian Inference and Learning in Spiking Neural Networks.

Probabilistic Inference of Binary Markov Random Fields in Spiking Neural Networks through Mean-field Approximation

Efficient Inference on a Network of Spiking Neurons using Deep Learning

Efficient Inference of Nonparametric Interaction in Spiking-neuron Networks

A sticky Poisson Hidden Markov Model for spike data

Deep Spiking Neural Network Using Spatio-temporal Backpropagation with Variable Resistance.

Neural Network Implementation of Inference on Binary Markov Random Fields with Probability Coding

Inferring Effective Networks of Spiking Neurons Using a Continuous-Time Estimator of Transfer Entropy

A Spiking Neural Network System for Robust Sequence Recognition

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

Nonlinear Modeling of Neural Interaction for Spike Prediction Using the Staged Point-Process Model

Versatile networks of simulated spiking neurons displaying winner-take-all behavior

Inference on the Macroscopic Dynamics of Spiking Neurons

Unification of MAP Estimation and Marginal Inference in Recurrent Neural Networks

Implementation of Bayesian Inference in Distributed Neural Networks

Efficient Inference for Dynamic Flexible Interactions of Neural Populations

VOWEL: A Local Online Learning Rule for Recurrent Networks of Probabilistic Spiking Winner-Take-All Circuits

Decoding Spiking Mechanism with Dynamic Learning on Neuron Population

A probabilistic model for learning in cortical microcircuit motifs with data-based divisive inhibition