Abstract:Neurons communicate nonlinearly through spike activities. Generalized linear models (GLMs) describe spike activities with a cascade of a linear combination across inputs, a static nonlinear function, and an inhomogeneous Bernoulli or Poisson process, or Cox process if a self-history term is considered. This structure considers the output nonlinearity in spike generation but excludes the nonlinear interaction among input neurons. Recent studies extend GLMs by modeling the interaction among input neurons with a quadratic function, which considers the interaction between every pair of input spikes. However, quadratic effects may not fully capture the nonlinear nature of input interaction. We therefore propose a staged point-process model to describe the nonlinear interaction among inputs using a few hidden units, which follows the idea of artificial neural networks. The output firing probability conditioned on inputs is formed as a cascade of two linear-nonlinear (a linear combination plus a static nonlinear function) stages and an inhomogeneous Bernoulli process. Parameters of this model are estimated by maximizing the log likelihood on output spike trains. Unlike the iterative reweighted least squares algorithm used in GLMs, where the performance is guaranteed by the concave condition, we propose a modified Levenberg-Marquardt(L-M) algorithm, which directly calculates the Hessian matrix of the log likelihood, for the nonlinear optimization in our model. The proposed model is tested on both synthetic data and real spike train data recorded from the dorsal premotor cortex and primary motor cortex of a monkey performing a center-out task. Performances are evaluated by discrete-time rescaled Kolmogorov-Smirnov tests, where our model statistically outperforms a GLM and its quadratic extension, with a higher goodness-of-fit in the prediction results. In addition, the staged point-process model describes nonlinear interaction among input neurons with fewer parameters than quadratic models, and the modified L-M algorithm also demonstrates fast convergence.

Nonlinear System Modeling Using Multiple Neural Networks

Nonlinear adaptive control based on RBF networks and multi-model method

Application study of a kind of novel neural networks models

Different‐factor Compact‐form Model‐free Adaptive Control with Neural Networks for MIMO Nonlinear Systems

Nonlinear model predictive control based on multiple neural networks

Neural network model based predictive control for multivariable nonlinear systems

A Novel Nonlinear Dynamic System Modeling Approach Using Radial Basis Function Neural Networks

Nonlinear Predictive Control With Error Compensation Based On Neural Network

Neural Network Based Multi-Step Predictive Control for Nonlinear Systems

Multi-loop nonlinear internal model controller design under nonlinear dynamic PLS framework using ARX-neural network model

A New Neural Network Model And Its Application

System Modeling Research on Based on Neural Netwroks

Design Of Model Predictive Controller Based On Neural Systems

Multiple Model Adaptive Control for a Class of Nonlinear Systems with Unknown Control Directions.

Support Vector Regression Based Nonlinear Model Reference Adaptive Control

Nonlinear Modeling of Neural Interaction for Spike Prediction Using the Staged Point-Process Model

Universal Approximation of Multiple Nonlinear Operators by Neural Networks

Strategies for constructing mathematical models of nonlinear systems based on multiple linear regression models

Application of nonlinear partial least square in catalyst modeling

Non-linear system modeling using LSTM neural networks

Neural network modeling and dynamic behavior prediction of nonlinear dynamic systems