Abstract:The proliferation of machine learning algorithms in everyday applications such as image recognition or language translation has increased the pressure to adapt underlying computing architectures towards these algorithms. Application specific integrated circuits (ASICs) such as the Tensor Processing Units by Google, Hanguang by Alibaba or Inferentia by Amazon Web Services were designed specifically for machine learning algorithms and have been able to outperform CPU based solutions by great margins during training and inference. As newer generations of chips allow handling of and computation on more and more data, the size of neural networks has dramatically increased, while the challenges they are trying to solve have become more complex. Neuromorphic computing tries to take inspiration from biological information processing systems, aiming to further improve the efficiency with which these networks can be trained or the inference can be performed. Enhancing neuromorphic computing architectures with memristive devices as non-volatile storage elements could potentially allow for even higher energy efficiencies. Their ability to mimic synaptic plasticity dynamics brings neuromorphic architectures closer to the biological role models. So far, memristive devices are mainly investigated for the emulation of the weights of neural networks during training and inference as their non-volatility would enable both processes in the same location without data transfer. In this paper, we explore realisations of different synapses build from memristive ReRAM devices, based on the Valence Change Mechanism. These synapses are the 1R synapse, the NR synapse and the 1T1R synapse. For the 1R synapse, we propose three dynamical regimes and explore their performance through different synapse criteria. For the NR synapse, we discuss how the same dynamical regimes can be addressed in a more reliable way. We also show experimental results measured on ZrO x devices to support our simulation based claims. For the 1T1R synapse, we explore the trade offs between the connection direction of the ReRAM device and the transistor. For all three synapse concepts we discuss the impact of device-to-device and cycle-to-cycle variability. Additionally, the impact of the stimulation mode on the observed behavior is discussed.

Configurable Synaptic and Stochastic Neuronal Functions in ZnTe-Based Memristor for an RBM Neural Network

Memristors with Tunable Characteristics Based on the Tellurene/nb-Doped MoS2 Heterojunction Toward Bio-Realistic Synaptic Emulation

Exploring conductance modulation and implementation of convolutional neural network in Pt/ZnO/Al2O3/TaN memristors for brain-inspired computing

Transition from synaptic simulation to nonvolatile resistive switching behavior based on an Ag/Ag:ZnO/Pt memristor.

Controlled Memory and Threshold Switching Behaviors in a Heterogeneous Memristor for Neuromorphic Computing

Electronically Reconfigurable Memristive Neuron Capable of Operating in Both Excitation and Inhibition Modes

Tailor-made synaptic dynamics based on memristive devices

A TaOx/TiOy Bilayer Memristor with Enhanced Synaptic Features for Neuromorphic Computing

Efficient Implementation of Synaptic Learning Rules for Neuromorphic Computing Based on Plasma-Treated ZnO Nanowire Memristors

Truly Concomitant and Independently Expressed Short‐ and Long‐Term Plasticity in a Bi2O2Se‐Based Three‐Terminal Memristor

Multistate Resistive Switching with Self-Rectifying Behavior and Synaptic Characteristics in a Solution-processed ZnO/PTAA Bilayer Memristor

Electronic synapses mimicked in bilayer organic-inorganic heterojunction based memristor

A Low Power Memristor Based on 2H-Mote2 Nanosheets with Synaptic Plasticity and Arithmetic Functions

Co-existence of bipolar nonvolatile and volatile resistive switching based on WO 3 nanowire for applications in neuromorphic computing and selective memory

Versatile Cu2ZnSnS4-based synaptic memristor for multi-field-regulated neuromorphic applications

Organic Heterojunction Memristors with Enhanced Tunable Resistive States for Artificial Synapses

Configurable NbOx Memristors as Artificial Synapses or Neurons Achieved by Regulating the Forming Compliance Current for the Spiking Neural Network

Phase-Change Nanoclusters Embedded In A Memristor For Simulating Synaptic Learning

A sub-1-volt analog metal oxide memristive-based synaptic device for energy-efficient spike-based computing systems

'Stateful' Threshold Switching for Neuromorphic Learning.

Optoelectronic bio-synaptic plasticity on neotype kesterite memristor with switching ratio >104