Abstract:Neurons communicate nonlinearly through spike activities. Generalized linear models (GLMs) describe spike activities with a cascade of a linear combination across inputs, a static nonlinear function, and an inhomogeneous Bernoulli or Poisson process, or Cox process if a self-history term is considered. This structure considers the output nonlinearity in spike generation but excludes the nonlinear interaction among input neurons. Recent studies extend GLMs by modeling the interaction among input neurons with a quadratic function, which considers the interaction between every pair of input spikes. However, quadratic effects may not fully capture the nonlinear nature of input interaction. We therefore propose a staged point-process model to describe the nonlinear interaction among inputs using a few hidden units, which follows the idea of artificial neural networks. The output firing probability conditioned on inputs is formed as a cascade of two linear-nonlinear (a linear combination plus a static nonlinear function) stages and an inhomogeneous Bernoulli process. Parameters of this model are estimated by maximizing the log likelihood on output spike trains. Unlike the iterative reweighted least squares algorithm used in GLMs, where the performance is guaranteed by the concave condition, we propose a modified Levenberg-Marquardt(L-M) algorithm, which directly calculates the Hessian matrix of the log likelihood, for the nonlinear optimization in our model. The proposed model is tested on both synthetic data and real spike train data recorded from the dorsal premotor cortex and primary motor cortex of a monkey performing a center-out task. Performances are evaluated by discrete-time rescaled Kolmogorov-Smirnov tests, where our model statistically outperforms a GLM and its quadratic extension, with a higher goodness-of-fit in the prediction results. In addition, the staged point-process model describes nonlinear interaction among input neurons with fewer parameters than quadratic models, and the modified L-M algorithm also demonstrates fast convergence.

Neural Partially Linear Additive Model

Which Neural Network Makes More Explainable Decisions? an Approach Towards Measuring Explainability

An Interpretable Neural Network Model Through Piecewise Linear Approximation

Visualizing and Understanding Neural Models in NLP

Neural Additive Models for Location Scale and Shape: A Framework for Interpretable Neural Regression Beyond the Mean

Deep PLS: A Lightweight Deep Learning Model for Interpretable and Efficient Data Analytics

GAMI-Net: An Explainable Neural Network based on Generalized Additive Models with Structured Interactions

Nonlinear Modeling of Neural Interaction for Spike Prediction Using the Staged Point-Process Model

Higher-order Neural Additive Models: An Interpretable Machine Learning Model with Feature Interactions

Analyzing and Improving Supervised Nonlinear Dynamical Probabilistic Latent Variable Model for Inferential Sensors

Neural Generators of Sparse Local Linear Models for Achieving both Accuracy and Interpretability

Sparse Model Identification and Learning for Ultra-high-dimensional Additive Partially Linear Models

Discovering Model Structure for Partially Linear Models

How Well Do Feature-Additive Explainers Explain Feature-Additive Predictors?

Generalized Groves of Neural Additive Models: Pursuing transparent and accurate machine learning models in finance

Neural network models and shapley additive explanations for a beam-ring structure

How to Explain Neural Networks: an Approximation Perspective

The Intriguing Properties of Model Explanations

Explainable Automatic Grading with Neural Additive Models

Improving Neural Additive Models with Bayesian Principles