Abstract:Spiking neural networks (SNNs) are a computational tool in which the information is coded into spikes, as in some parts of the brain, differently from conventional neural networks (NNs) that compute over real-numbers. Therefore, SNNs can implement intelligent information extraction in real-time at the edge of data acquisition and correspond to a complementary solution to conventional NNs working for cloud-computing. Both NN classes face hardware constraints due to limited computing parallelism and separation of logic and memory. Emerging memory devices, like resistive switching memories, phase change memories, or memristive devices in general are strong candidates to remove these hurdles for NN applications. The well-established training procedures of conventional NNs helped in defining the desiderata for memristive device dynamics implementing synaptic units. The generally agreed requirements are a linear evolution of memristive conductance upon stimulation with train of identical pulses and a symmetric conductance change for conductance increase and decrease. Conversely, little work has been done to understand the main properties of memristive devices supporting efficient SNN operation. The reason lies in the lack of a background theory for their training. As a consequence, requirements for NNs have been taken as a reference to develop memristive devices for SNNs. In the present work, we show that, for efficient CMOS/memristive SNNs, the requirements for synaptic memristive dynamics are very different from the needs of a conventional NN. System-level simulations of a SNN trained to classify hand-written digit images through a spike timing dependent plasticity protocol are performed considering various linear and non-linear plausible synaptic memristive dynamics. We consider memristive dynamics bounded by artificial hard conductance values and limited by the natural dynamics evolution toward asymptotic values (soft-boundaries). We quantitatively analyze the impact of resolution and non-linearity properties of the synapses on the network training and classification performance. Finally, we demonstrate that the non-linear synapses with hard boundary values enable higher classification performance and realize the best trade-off between classification accuracy and required training time. With reference to the obtained results, we discuss how memristive devices with non-linear dynamics constitute a technologically convenient solution for the development of on-line SNN training.

Synaptic coupling and synchronization for HR neural network developing a novel type II non-linear memristor, potential to neuromorphic application

Hybrid Dual-Complementary Metal-Oxide-semiconductor/memristor Synapse-Based Neural Network with Its Applications in Image Super-Resolution

An Investigation into Neuromorphic ICs using Memristor-CMOS Hybrid Circuits

Firing activities analysis of a novel small heterogeneous coupled network through a memristive synapse

Multiple firing patterns, energy conversion and hardware implementation within Hindmarsh-Rose-improved neuron model

Firing and synchronous of two memristive neurons

Energy balance via memristor synapse in Morris-Lecar two-neuron network with FPGA implementation

Coexisting firing patterns and phase synchronization in locally active memristor coupled neurons with HR and FN models

Memristor synapse-coupled piecewise-linear simplified Hopfield neural network: Dynamics analysis and circuit implementation

Dynamics and synchronization of neural models with memristive membranes under energy coupling

Dual-terminal artificial synapse in two-dimensional CrSBr memristor for neuromorphic computing

Dynamic symmetrization in a memristive HR neuron

Magnetic Tunnel Junction Based Long-Term Short-Term Stochastic Synapse for a Spiking Neural Network with On-Chip STDP Learning

Non-linear Memristive Synaptic Dynamics for Efficient Unsupervised Learning in Spiking Neural Networks

Nanoscale Memristor Device as Synapse in Neuromorphic Systems

Switchable memristor-based Hindmarsh-Rose neuron under electromagnetic radiation

A novel compound synapse using probabilistic spin-orbit-torque switching for MTJ based deep neural networks

Dynamic analysis and hardware implementation of multi-scroll Hopfield neural networks with three different memristor synapses

Influences of short-term and long-term plasticity of memristive synapse on firing activity of neuronal network

Enhanced Read Resolution in Reconfigurable Memristive Synapses for Spiking Neural Networks