Abstract:Modeling spike train transformation among brain regions helps in designing a cognitive neural prosthesis that restores lost cognitive functions. Various methods analyze the nonlinear dynamic spike train transformation between two cortical areas with low computational eficiency. The application of a real-time neural prosthesis requires computational eficiency, performance stability, and better interpretation of the neural firing patterns that modulate target spike generation. We propose the binless kernel machine in the point-process framework to describe nonlinear dynamic spike train transformations. Our approach embeds the binless kernel to eficiently capture the feedforward dynamics of spike trains and maps the input spike timings into reproducing kernel Hilbert space (RKHS). An inhomogeneous Bernoulli process is designed to combine with a kernel logistic regression that operates on the binless kernel to generate an output spike train as a point process. Weights of the proposed model are estimated by maximizing the log likelihood of output spike trains in RKHS, which allows a global-optimal solution. To reduce computational complexity, we design a streaming-based clustering algorithm to extract typical and important spike train features. The cluster centers and their weights enable the visualization of the important input spike train patterns that motivate or inhibit output neuron firing. We test the proposed model on both synthetic data and real spike train data recorded from the dorsal premotor cortex and the primary motor cortex of a monkey performing a center-out task. Performances are evaluated by discrete-time rescaling Kolmogorov-Smirnov tests. Our model outperforms the existing methods with higher stability regardless of weight initialization and demonstrates higher eficiency in analyzing neural patterns from spike timing with less historical input (50%). Meanwhile, the typical spike train patterns selected according to weights are validated to encode output spike from the spike train of single-input neuron and the interaction of two input neurons.

A Computational Model of Match Decision-Making Problem Using Spiking SHESN with Reward-Modulated Reinforcement Learning.

Reinforcement Learning in Spiking Neural Networks with Stochastic and Deterministic Synapses

Mechanisms Of Reward-Modulated Stdp And Winner-Take-All In Bayesian Spiking Decision-Making Circuit

A Neural Model of the Frontal Eye Fields with Reward-Based Learning.

A Decision-Making Model Based on a Spiking Neural Circuit and Synaptic Plasticity.

Training a Two-Choice Decision-Making Model with Environment Feedback.

A Stochastic Policy Search Model for Matching Behavior

A Spike-Timing Based Integrated Model for Pattern Recognition

Sparse ESN with a Leaky Integrator for Matching Decision-Making Problems

A computational model of behavioral adaptation to solve the credit assignment problem

Towards free-response paradigm: a theory on decision-making in spiking neural networks

Spiking-timing based pattern recognition with real-world visual stimuli

Conflict Resolution as Near-Threshold Decision-Making: A Spiking Neural Circuit Model with Two-Stage Competition for Antisaccadic Task

Toward Efficient Processing and Learning with Spikes: New Approaches for Multispike Learning

Binless Kernel Machine: Modeling Spike Train Transformation for Cognitive Neural Prostheses

Coherent noise enables probabilistic sequence replay in spiking neuronal networks

Predicting Spike Trains from PMd to M1 Using Discrete Time Rescaling Targeted GLM.

A fully spiking coupled model of a deep neural network and a recurrent attractor explains dynamics of decision making in an object recognition task

Unleashing the Potential of Spiking Neural Networks for Sequential Modeling with Contextual Embedding.

Episodic memory governs choices: An RNN-based reinforcement learning model for decision-making task

HMM for Discovering Decision-Making Dynamics Using Reinforcement Learning Experiments