Abstract:Neurons communicate nonlinearly through spike activities. Generalized linear models (GLMs) describe spike activities with a cascade of a linear combination across inputs, a static nonlinear function, and an inhomogeneous Bernoulli or Poisson process, or Cox process if a self-history term is considered. This structure considers the output nonlinearity in spike generation but excludes the nonlinear interaction among input neurons. Recent studies extend GLMs by modeling the interaction among input neurons with a quadratic function, which considers the interaction between every pair of input spikes. However, quadratic effects may not fully capture the nonlinear nature of input interaction. We therefore propose a staged point-process model to describe the nonlinear interaction among inputs using a few hidden units, which follows the idea of artificial neural networks. The output firing probability conditioned on inputs is formed as a cascade of two linear-nonlinear (a linear combination plus a static nonlinear function) stages and an inhomogeneous Bernoulli process. Parameters of this model are estimated by maximizing the log likelihood on output spike trains. Unlike the iterative reweighted least squares algorithm used in GLMs, where the performance is guaranteed by the concave condition, we propose a modified Levenberg-Marquardt(L-M) algorithm, which directly calculates the Hessian matrix of the log likelihood, for the nonlinear optimization in our model. The proposed model is tested on both synthetic data and real spike train data recorded from the dorsal premotor cortex and primary motor cortex of a monkey performing a center-out task. Performances are evaluated by discrete-time rescaled Kolmogorov-Smirnov tests, where our model statistically outperforms a GLM and its quadratic extension, with a higher goodness-of-fit in the prediction results. In addition, the staged point-process model describes nonlinear interaction among input neurons with fewer parameters than quadratic models, and the modified L-M algorithm also demonstrates fast convergence.

PSO-based Single Multiplicative Neuron Model for Time Series Prediction

PSO-NN Model of Settlement Prediction of Road Soft Foundation

CRPSO-based integrate-and-fire neuron model for time series prediction

A nonlinear model predictive control based on PSO algorithm

GRU-corr Neural Network Optimized by Improved PSO Algorithm for Time Series Prediction

An Ensemble of Single Multiplicative Neuron Models for Probabilistic Prediction

PSO based Neural Networks vs. Traditional Statistical Models for Seasonal Time Series Forecasting

Short-term wind speed prediction of wind farms based on improved particle swarm optimization algorithm and neural network

Improved Social Emotion Optimization Algorithm for Short-Term Traffic Flow Forecasting Based on Back-Propagation Neural Network

Short-Term Electricity Price Forecasting Based on Mpso-Bp Algorithm

Multiplicative neuron model artificial neural network based on Gaussian activation function

Nonlinear Modeling of Neural Interaction for Spike Prediction Using the Staged Point-Process Model

A Dendritic Neuron Model Optimized by Meta-Heuristics with a Power-Law-Distributed Population Interaction Network for Financial Time-Series Forecasting

Short-term power load forecasting based on PSO-GRU

A Time Series Forecasting Approach Based on Nonlinear Spiking Neural Systems

Application of neural network based on particle swarm optimization in short-term load forecasting

Fuzzy Neural Network Model Based on Particle Swarm Optimization for Short-term Load Forecasting

NPP Accident Prevention: Integrated Neural Network for Coupled Multivariate Time Series Prediction Based on PSO and Its Application under Uncertainty Analysis for NPP Data

Optimization Algorithm with Kernel PCA to Support Vector Machines for Time Series Prediction

Design of Drug Sales Forecasting Model Using Particle Swarm Optimization Neural Networks Model

Self-Adaptive Particle Swarm Optimization-Based Echo State Network for Time Series Prediction