Abstract:Spiking neural network is a type of artificial neural network in which neurons communicate between each other with spikes. Spikes are identical Boolean events characterized by the time of their arrival. A spiking neuron has internal dynamics and responds to the history of inputs as opposed to the current inputs only. Because of such properties a spiking neural network has rich intrinsic capabilities to process spatiotemporal data. However, because the spikes are discontinuous 'yes or no' events, it is not trivial to apply traditional training procedures such as gradient descend to the spiking neurons. In this thesis we propose to use stochastic spiking neuron models in which probability of a spiking output is a continuous function of parameters. We formulate several learning tasks as minimization of certain information-theoretic cost functions that use spiking output probability distributions. We develop a generalized description of the stochastic spiking neuron and a new spiking neuron model that allows to flexibly process rich spatiotemporal data. We formulate and derive learning rules for the following tasks: - a supervised learning task of detecting a spatiotemporal pattern as a minimization of the negative log-likelihood (the surprisal) of the neuron's output - an unsupervised learning task of increasing the stability of neurons output as a minimization of the entropy - a reinforcement learning task of controlling an agent as a modulated optimization of filtered surprisal of the neuron's output. We test the derived learning rules in several experiments such as spatiotemporal pattern detection, spatiotemporal data storing and recall with autoassociative memory, combination of supervised and unsupervised learning to speed up the learning process, adaptive control of simple virtual agents in changing environments.

Supervised Learning Based on Temporal Coding in Spiking Neural Networks

Efficient Spiking Neural Networks with Logarithmic Temporal Coding.

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

Unsupervised Learning Based on Temporal Coding Using STDP in Spiking Neural Networks.

Pattern Recognition Computation in a Spiking Neural Network with Temporal Encoding and Learning

A Supervised Multi-Spike Learning Algorithm for Spiking Neural Networks

A Spiking Neural Network Model For Associative Memory Using Temporal Codes

Temporal Pattern Recognition Using Spiking Neural Networks for Cortical Neuronal Spike Train Decodin

An Efficient Learning Algorithm for Direct Training Deep Spiking Neural Networks

Sparse Temporal Encoding of Visual Features for Robust Object Recognition by Spiking Neurons

A Hybrid Learning Framework for Deep Spiking Neural Networks with One-Spike Temporal Coding

Gradient Descent for Spiking Neural Networks

An STDP-Based Supervised Learning Algorithm for Spiking Neural Networks

Rapid Feedforward Computation by Temporal Encoding and Learning with Spiking Neurons

Toward Efficient Processing and Learning with Spikes: New Approaches for Multispike Learning

Supervised Learning with First-to-Spike Decoding in Multilayer Spiking Neural Networks

Learning Real-World Stimuli By Single-Spike Coding And Tempotron Rule

A Spike-Timing Based Integrated Model for Pattern Recognition

Reinforcement learning of recurrent neural network for temporal coding

Training of spiking neural networks based on information theoretic costs

Supervised Learning in Multilayer Spiking Neural Networks With Spike Temporal Error Backpropagation