Abstract:Neurons communicate nonlinearly through spike activities. Generalized linear models (GLMs) describe spike activities with a cascade of a linear combination across inputs, a static nonlinear function, and an inhomogeneous Bernoulli or Poisson process, or Cox process if a self-history term is considered. This structure considers the output nonlinearity in spike generation but excludes the nonlinear interaction among input neurons. Recent studies extend GLMs by modeling the interaction among input neurons with a quadratic function, which considers the interaction between every pair of input spikes. However, quadratic effects may not fully capture the nonlinear nature of input interaction. We therefore propose a staged point-process model to describe the nonlinear interaction among inputs using a few hidden units, which follows the idea of artificial neural networks. The output firing probability conditioned on inputs is formed as a cascade of two linear-nonlinear (a linear combination plus a static nonlinear function) stages and an inhomogeneous Bernoulli process. Parameters of this model are estimated by maximizing the log likelihood on output spike trains. Unlike the iterative reweighted least squares algorithm used in GLMs, where the performance is guaranteed by the concave condition, we propose a modified Levenberg-Marquardt(L-M) algorithm, which directly calculates the Hessian matrix of the log likelihood, for the nonlinear optimization in our model. The proposed model is tested on both synthetic data and real spike train data recorded from the dorsal premotor cortex and primary motor cortex of a monkey performing a center-out task. Performances are evaluated by discrete-time rescaled Kolmogorov-Smirnov tests, where our model statistically outperforms a GLM and its quadratic extension, with a higher goodness-of-fit in the prediction results. In addition, the staged point-process model describes nonlinear interaction among input neurons with fewer parameters than quadratic models, and the modified L-M algorithm also demonstrates fast convergence.

On Gaussian Random Neuronal Field Model: Moment Neuronal Network Approach

On a Gaussian Neuronal Field Model

Moment neural network and an efficient numerical method for modeling irregular spiking activity

Dynamics of Moment Neuronal Networks

Analytic Investigation for Synchronous Firing Patterns Propagation in Spiking Neural Networks

Moment Neuronal Networks: Stochastic Computation in Neuronal Systems

Dynamical mean-field theory of spiking neuron ensembles: response to a single spike with independent noises

Mean-field approximations for coupled populations of generalized linear model spiking neurons with Markov refractoriness

Nonlinear Modeling of Neural Interaction for Spike Prediction Using the Staged Point-Process Model

Firing rate and spatial correlation in a stochastic neural field model

Neuronal Synfire Chain via Moment Neuronal Network Approach

A Mean Field to Capture Asynchronous Irregular Dynamics of Conductance-Based Networks of Adaptive Quadratic Integrate-and-Fire Neuron Models

Modeling Neuromorphic Persistent Firing Networks

Dynamic Moment Analysis of the Extracellular Electric Field of a Biologically Realistic Spiking Neuron

A stochastic-field description of finite-size spiking neural networks

Oscillations and irregular persistent firing patterns in a homogeneous network of excitatory stochastic neurons with gap junctions in the mean-field limit

Mean-field approximations of networks of spiking neurons with short-term synaptic plasticity

Model-agnostic neural mean field with a data-driven transfer function

The mean-field Limit of sparse networks of integrate and fire neurons

Investigating the Integrate and Fire Model As the Limit of a Random Discharge Model: a Stochastic Analysis Perspective

A Coarse-Grained Framework for Spiking Neuronal Networks: Between Homogeneity and Synchrony