Abstract:The proliferation of machine learning algorithms in everyday applications such as image recognition or language translation has increased the pressure to adapt underlying computing architectures towards these algorithms. Application specific integrated circuits (ASICs) such as the Tensor Processing Units by Google, Hanguang by Alibaba or Inferentia by Amazon Web Services were designed specifically for machine learning algorithms and have been able to outperform CPU based solutions by great margins during training and inference. As newer generations of chips allow handling of and computation on more and more data, the size of neural networks has dramatically increased, while the challenges they are trying to solve have become more complex. Neuromorphic computing tries to take inspiration from biological information processing systems, aiming to further improve the efficiency with which these networks can be trained or the inference can be performed. Enhancing neuromorphic computing architectures with memristive devices as non-volatile storage elements could potentially allow for even higher energy efficiencies. Their ability to mimic synaptic plasticity dynamics brings neuromorphic architectures closer to the biological role models. So far, memristive devices are mainly investigated for the emulation of the weights of neural networks during training and inference as their non-volatility would enable both processes in the same location without data transfer. In this paper, we explore realisations of different synapses build from memristive ReRAM devices, based on the Valence Change Mechanism. These synapses are the 1R synapse, the NR synapse and the 1T1R synapse. For the 1R synapse, we propose three dynamical regimes and explore their performance through different synapse criteria. For the NR synapse, we discuss how the same dynamical regimes can be addressed in a more reliable way. We also show experimental results measured on ZrO x devices to support our simulation based claims. For the 1T1R synapse, we explore the trade offs between the connection direction of the ReRAM device and the transistor. For all three synapse concepts we discuss the impact of device-to-device and cycle-to-cycle variability. Additionally, the impact of the stimulation mode on the observed behavior is discussed.

ASTERS: Adaptable Threshold Spike-timing Neuromorphic Design with Twin-Column ReRAM Synapses

Multicore Spiking Neuromorphic Chip in 180-nm with ReRAM Synapses and Digital Neurons

Computing of temporal information in spiking neural networks with ReRAM synapses

A Spike Neuron Network Prototype Based on RRAM Array

Spiking Neural Network with RRAM: Can We Use It for Real-World Application?

A Novel Neuromorphic Hardware Using Area-Efficient Chain RRAM-Based Synapses and Compact Neurons with (Anti-) Integration Scheme

A Neuromorphic Core Based on Threshold Switching Memristor with Asynchronous Address Event Representation Circuits

A Spike-Event-Based Neuromorphic Processor with Enhanced On-Chip STDP Learning in 28nm CMOS

Improving Robustness of ReRAM-based Spiking Neural Network Accelerator with Stochastic Spike-timing-dependent-plasticity

Tempo-CIM: A RRAM Compute-in-Memory Neuromorphic Accelerator with Area-Efficient LIF Neuron and Split-Train-Merged-Inference Algorithm for Edge AI Applications.

Tailor-made synaptic dynamics based on memristive devices

AERIS: Area/Energy-Efficient lT2R ReRAM Based Processing-in-Memory Neural Network System-on-a-Chip

An 1.38nj/inference Clock-Free Mixed-Signal Neuromorphic Architecture Using ReL-PSP Function and Computing-in-Memory.

Self-Terminating Write of Multi-Level Cell ReRAM for Efficient Neuromorphic Computing

Spiking Neurons with Neural Dynamics Implemented Using Stochastic Memristors

Achieving Neuronal Dynamics with Spike Encoding and Spatial-Temporal Summation in Vanadium-based Threshold Switching Memristor for Asynchronous Signal Integration

AERIS - area/energy-efficient 1T2R ReRAM based processing-in-memory neural network system-on-a-chip.

SpiDR: A Reconfigurable Digital Compute-in-Memory Spiking Neural Network Accelerator for Event-based Perception

Metal Oxide Resistive Random Access Memory Based Synaptic Devices for Brain-Inspired Computing

ReSiPE: ReRAM-based Single-Spiking Processing-In-Memory Engine.

Energy Efficient RRAM Spiking Neural Network for Real Time Classification