Abstract:The proliferation of machine learning algorithms in everyday applications such as image recognition or language translation has increased the pressure to adapt underlying computing architectures towards these algorithms. Application specific integrated circuits (ASICs) such as the Tensor Processing Units by Google, Hanguang by Alibaba or Inferentia by Amazon Web Services were designed specifically for machine learning algorithms and have been able to outperform CPU based solutions by great margins during training and inference. As newer generations of chips allow handling of and computation on more and more data, the size of neural networks has dramatically increased, while the challenges they are trying to solve have become more complex. Neuromorphic computing tries to take inspiration from biological information processing systems, aiming to further improve the efficiency with which these networks can be trained or the inference can be performed. Enhancing neuromorphic computing architectures with memristive devices as non-volatile storage elements could potentially allow for even higher energy efficiencies. Their ability to mimic synaptic plasticity dynamics brings neuromorphic architectures closer to the biological role models. So far, memristive devices are mainly investigated for the emulation of the weights of neural networks during training and inference as their non-volatility would enable both processes in the same location without data transfer. In this paper, we explore realisations of different synapses build from memristive ReRAM devices, based on the Valence Change Mechanism. These synapses are the 1R synapse, the NR synapse and the 1T1R synapse. For the 1R synapse, we propose three dynamical regimes and explore their performance through different synapse criteria. For the NR synapse, we discuss how the same dynamical regimes can be addressed in a more reliable way. We also show experimental results measured on ZrO x devices to support our simulation based claims. For the 1T1R synapse, we explore the trade offs between the connection direction of the ReRAM device and the transistor. For all three synapse concepts we discuss the impact of device-to-device and cycle-to-cycle variability. Additionally, the impact of the stimulation mode on the observed behavior is discussed.

Spin-Transfer Torque Magnetic Memory As a Stochastic Memristive Synapse for Neuromorphic Systems

Multi-level cell Spin Transfer Torque MRAM based on stochastic switching

A novel compound synapse using probabilistic spin-orbit-torque switching for MTJ based deep neural networks

Stochastic Spintronic Device Based Synapses and Spiking Neurons for Neuromorphic Computation

Spin‐Torque Memristors Based on Perpendicular Magnetic Tunnel Junctions for Neuromorphic Computing

Monte-Carlo Simulations of Magnetic Tunnel Junctions: from Physics to Application

Spintronic Devices As Key Elements for Energy-Efficient Neuroinspired Architectures.

Intrinsic Spike Timing Dependent Plasticity in Stochastic Magnetic Tunnel Junctions Mediated by Heat Dynamics

Stochastic Artificial Synapses Based on Nanoscale Magnetic Tunnel Junction for Neuromorphic Applications

A memristive nanoparticle/organic hybrid synapstor for neuro-inspired computing

Controllable Resistive Switching of STO:Ag/SiO2-based Memristor Synapse for Neuromorphic Computing

Advanced Modeling and Simulation of Multilayer Spin–Transfer Torque Magnetoresistive Random Access Memory with Interface Exchange Coupling

Tailor-made synaptic dynamics based on memristive devices

Magnetic Tunnel Junction Based Long-Term Short-Term Stochastic Synapse for a Spiking Neural Network with On-Chip STDP Learning

A sub-1-volt analog metal oxide memristive-based synaptic device for energy-efficient spike-based computing systems

Magnonic spin-transfer torque MRAM with low power, high speed, and error-free switching

Memristor-based Synaptic Networks and Logical Operations Using In-Situ Computing

Self-Enabled "Error-Free" Switching Circuit For Spin Transfer Torque Mram And Logic

Neuromorphic Hebbian learning with magnetic tunnel junction synapses

Cross-Point Architecture for Spin-Transfer Torque Magnetic Random Access Memory

Emulating short-term synaptic dynamics with memristive devices