Abstract:Spikes are the currency in central nervous systems for information transmission and processing. They are also believed to play an essential role in low-power consumption of the biological systems, whose efficiency attracts increasing attentions to the field of neuromorphic computing. However, efficient processing and learning of discrete spikes still remain a challenging problem. In this article, we make our contributions toward this direction. A simplified spiking neuron model is first introduced with the effects of both synaptic input and firing output on the membrane potential being modeled with an impulse function. An event-driven scheme is then presented to further improve the processing efficiency. Based on the neuron model, we propose two new multispike learning rules which demonstrate better performance over other baselines on various tasks, including association, classification, and feature detection. In addition to efficiency, our learning rules demonstrate high robustness against the strong noise of different types. They can also be generalized to different spike coding schemes for the classification task, and notably, the single neuron is capable of solving multicategory classifications with our learning rules. In the feature detection task, we re-examine the ability of unsupervised spike-timing-dependent plasticity with its limitations being presented, and find a new phenomenon of losing selectivity. In contrast, our proposed learning rules can reliably solve the task over a wide range of conditions without specific constraints being applied. Moreover, our rules cannot only detect features but also discriminate them. The improved performance of our methods would contribute to neuromorphic computing as a preferable choice.

Optimizing Supervised Learning of Deep Spiking Neural Network towards Memristor Crossbar Implementation.

Aging Aware Retraining for Memristor-based Neuromorphic Computing

Toward Efficient Processing and Learning with Spikes: New Approaches for Multispike Learning

In-situ Learning in Hardware Compatible Multi-layer Memristive Spiking Neural Network

An Efficient Learning Algorithm for Direct Training Deep Spiking Neural Networks

Adaptive Multi-Level Firing for Direct Training Deep Spiking Neural Networks

Multi-optimization scheme for in-situ training of memristor neural network based on contrastive learning

Simulation of In-Situ Training in Spike Neural Network Based on Non-Ideal Memristors

Memristor-based Mixed Training Scheme with Multi-level Sparsification

Efficient Training of the Memristive Deep Belief Net Immune to Non-Idealities of the Synaptic Devices

A Memristor-Based Spiking Neural Network With High Scalability and Learning Efficiency

In Situ Training of Feed-Forward and Recurrent Convolutional Memristor Networks

An Efficient Programming Framework for Memristor-based Neuromorphic Computing

Unsupervised Learning of Spike-Timing-Dependent Plasticity Based on a Neuromorphic Implementation

Reliability-Driven Neural Network Training for Memristive Crossbar-Based Neuromorphic Computing Systems

On-Chip Error-Triggered Learning of Multi-Layer Memristive Spiking Neural Networks

A new pre-conditioned STDP rule and its hardware implementation in neuromorphic crossbar array

A progressive surrogate gradient learning for memristive spiking neural network

Spiking-based matrix computation by leveraging memristor crossbar array

Gradient Decomposition Methods for Training Neural Networks with Non-ideal Synaptic Devices

Fast and Accurate Sparse Coding of Visual Stimuli With a Simple, Ultralow-Energy Spiking Architecture