Abstract:Neurons communicate nonlinearly through spike activities. Generalized linear models (GLMs) describe spike activities with a cascade of a linear combination across inputs, a static nonlinear function, and an inhomogeneous Bernoulli or Poisson process, or Cox process if a self-history term is considered. This structure considers the output nonlinearity in spike generation but excludes the nonlinear interaction among input neurons. Recent studies extend GLMs by modeling the interaction among input neurons with a quadratic function, which considers the interaction between every pair of input spikes. However, quadratic effects may not fully capture the nonlinear nature of input interaction. We therefore propose a staged point-process model to describe the nonlinear interaction among inputs using a few hidden units, which follows the idea of artificial neural networks. The output firing probability conditioned on inputs is formed as a cascade of two linear-nonlinear (a linear combination plus a static nonlinear function) stages and an inhomogeneous Bernoulli process. Parameters of this model are estimated by maximizing the log likelihood on output spike trains. Unlike the iterative reweighted least squares algorithm used in GLMs, where the performance is guaranteed by the concave condition, we propose a modified Levenberg-Marquardt(L-M) algorithm, which directly calculates the Hessian matrix of the log likelihood, for the nonlinear optimization in our model. The proposed model is tested on both synthetic data and real spike train data recorded from the dorsal premotor cortex and primary motor cortex of a monkey performing a center-out task. Performances are evaluated by discrete-time rescaled Kolmogorov-Smirnov tests, where our model statistically outperforms a GLM and its quadratic extension, with a higher goodness-of-fit in the prediction results. In addition, the staged point-process model describes nonlinear interaction among input neurons with fewer parameters than quadratic models, and the modified L-M algorithm also demonstrates fast convergence.

Online Neural Sequence Detection with Hierarchical Dirichlet Point Process

Neural Decoding Using a Parallel Sequential Monte Carlo Method on Point Processes with Ensemble Effect.

Detecting Abnormal Events Via Hierarchical Dirichlet Processes.

Change Point Detection with Neural Online Density-Ratio Estimator

Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

Neuronal Sequence Models for Bayesian Online Inference

Nonlinear Modeling of Neural Interaction for Spike Prediction Using the Staged Point-Process Model

An Adaptive Online HDP-HMM for Segmentation and Classification of Sequential Data

Modelling event sequence data by type-wise neural point process

Probabilistic Modeling for Sequences of Sets in Continuous-Time

An Efficient Method for Online Detection of Polychronous Patterns in Spiking Neural Networks

Modeling The Intensity Function Of Point Process Via Recurrent Neural Networks

Particle-filtering approaches for nonlinear Bayesian decoding of neuronal spike trains

Data-driven perception of neuron point process with unknown unknowns

Hierarchical Dirichlet Processes with Social Influence

Learning Time Series Associated Event Sequences with Recurrent Point Process Networks

Neural Sampling in Hierarchical Exponential-family Energy-based Models

An Empirical Study: Extensive Deep Temporal Point Process

Continuous Online Sequence Learning with an Unsupervised Neural Network Model

From point process observations to collective neural dynamics: Nonlinear Hawkes process GLMs, low-dimensional dynamics and coarse graining