Abstract:Spiking neural networks (SNNs) are a computational tool in which the information is coded into spikes, as in some parts of the brain, differently from conventional neural networks (NNs) that compute over real-numbers. Therefore, SNNs can implement intelligent information extraction in real-time at the edge of data acquisition and correspond to a complementary solution to conventional NNs working for cloud-computing. Both NN classes face hardware constraints due to limited computing parallelism and separation of logic and memory. Emerging memory devices, like resistive switching memories, phase change memories, or memristive devices in general are strong candidates to remove these hurdles for NN applications. The well-established training procedures of conventional NNs helped in defining the desiderata for memristive device dynamics implementing synaptic units. The generally agreed requirements are a linear evolution of memristive conductance upon stimulation with train of identical pulses and a symmetric conductance change for conductance increase and decrease. Conversely, little work has been done to understand the main properties of memristive devices supporting efficient SNN operation. The reason lies in the lack of a background theory for their training. As a consequence, requirements for NNs have been taken as a reference to develop memristive devices for SNNs. In the present work, we show that, for efficient CMOS/memristive SNNs, the requirements for synaptic memristive dynamics are very different from the needs of a conventional NN. System-level simulations of a SNN trained to classify hand-written digit images through a spike timing dependent plasticity protocol are performed considering various linear and non-linear plausible synaptic memristive dynamics. We consider memristive dynamics bounded by artificial hard conductance values and limited by the natural dynamics evolution toward asymptotic values (soft-boundaries). We quantitatively analyze the impact of resolution and non-linearity properties of the synapses on the network training and classification performance. Finally, we demonstrate that the non-linear synapses with hard boundary values enable higher classification performance and realize the best trade-off between classification accuracy and required training time. With reference to the obtained results, we discuss how memristive devices with non-linear dynamics constitute a technologically convenient solution for the development of on-line SNN training.

A Software-equivalent SNN Hardware using RRAM-array for Asynchronous Real-time Learning

In-situ Learning in Hardware Compatible Multi-layer Memristive Spiking Neural Network

Spiking Neural Network with RRAM: Can We Use It for Real-World Application?

Machine Learning-Assisted Analysis of Advanced STDP for Neuromorphic Computing using MRAM

A Memristor-Based Spiking Neural Network With High Scalability and Learning Efficiency

Hardware calibrated learning to compensate heterogeneity in analog RRAM-based Spiking Neural Networks

Computing of temporal information in spiking neural networks with ReRAM synapses

Energy Efficient RRAM Spiking Neural Network for Real Time Classification

Spiking Neurons with Neural Dynamics Implemented Using Stochastic Memristors

Unsupervised Learning on Resistive Memory Array Based Spiking Neural Networks

A Neuromorphic-Hardware Oriented Bio-Plausible Online-Learning Spiking Neural Network Model.

Exploiting the Electrothermal Timescale in PrMnO3 RRAM for a compact, clock-less neuron exhibiting biological spiking patterns

Non-linear Memristive Synaptic Dynamics for Efficient Unsupervised Learning in Spiking Neural Networks

A Low-Cost Hardware-Friendly Spiking Neural Network Based on Binary MRAM Synapses, Accelerated Using In-Memory Computing

An Area- and Energy-Efficient Spiking Neural Network with Spike-Time-Dependent Plasticity Realized with SRAM Processing-in-Memory Macro and On-Chip Unsupervised Learning.

Unsupervised learning in hexagonal boron nitride memristor-based spiking neural networks

Hardware Demonstration of SRDP Neuromorphic Computing with Online Unsupervised Learning Based on Memristor Synapses

Comparing domain wall synapse with other Non Volatile Memory devices for on-chip learning in Analog Hardware Neural Network

CMOS Circuit Implementation of Spiking Neural Network for Pattern Recognition Using On-chip Unsupervised STDP Learning

Non-spike Timing-Dependent Plasticity Learning Mechanism for Memristive Neural Networks