Abstract:The brain performs intelligent tasks with extremely low energy consumption. This work takes its inspiration from two strategies used by the brain to achieve this energy efficiency: the absence of separation between computing and memory functions and reliance on low-precision computation. The emergence of resistive memory technologies indeed provides an opportunity to tightly co-integrate logic and memory in hardware. In parallel, the recently proposed concept of a Binarized Neural Network, where multiplications are replaced by exclusive NOR (XNOR) logic gates, offers a way to implement artificial intelligence using very low precision computation. In this work, we therefore propose a strategy for implementing low-energy Binarized Neural Networks that employs brain-inspired concepts while retaining the energy benefits of digital electronics. We design, fabricate, and test a memory array, including periphery and sensing circuits, that is optimized for this in-memory computing scheme. Our circuit employs hafnium oxide resistive memory integrated in the back end of line of a 130-nm CMOS process, in a two-transistor, two-resistor cell, which allows the exclusive NOR operations of the neural network to be performed directly within the sense amplifiers. We show, based on extensive electrical measurements, that our design allows a reduction in the number of bit errors on the synaptic weights without the use of formal error-correcting codes. We design a whole system using this memory array. We show on standard machine learning tasks (MNIST, CIFAR-10, ImageNet, and an ECG task) that the system has inherent resilience to bit errors. We evidence that its energy consumption is attractive compared to more standard approaches and that it can use memory devices in regimes where they exhibit particularly low programming energy and high endurance. We conclude the work by discussing how it associates biologically plausible ideas with more traditional digital electronics concepts.

Weight Discretized BP Algorithm Based on Synapse Transistor with Symmetric/Asymmetric Memory Curve

Deep Spiking Neural Networks with Binary Weights for Object Recognition

Neuromorphic Extreme Learning Machines with Bimodal Memristive Synapses

A A 22nm 0.43pJ/SOP Sparsity-Aware In-Memory Neuromorphic Computing System with Hybrid Spiking and Artificial Neural Network and Configurable Topology

Binary Resistive-Switching-Device-Based Electronic Synapse with Spike-Rate-Dependent Plasticity for Online Learning

Implementation of Multiple-Step Quantized STDP Based on Novel Memristive Synapses

Rectified Linear Postsynaptic Potential Function for Backpropagation in Deep Spiking Neural Networks

Optimizing BCPNN Learning Rule for Memory Access

CIMulator: A Comprehensive Simulation Platform for Computing-In-Memory Circuit Macros with Low Bit-Width and Real Memory Materials

Reconfigurable Artificial Synapse Based on Ambipolar Floating Gate Memory

Emulating Complex Synapses Using Interlinked Proton Conductors

Batch Normalization-Free Weight-Binarized SNN Based on Hardware-Saving IF Neuron.

Deep Spiking Binary Neural Network for Digital Neuromorphic Hardware

1S1R Optimization for High‐Frequency Inference on Binarized Spiking Neural Networks

Algorithm for Optimizing Bipolar Interconnection Weights with Applications in Associative Memories and Multitarget Classification.

Binary stochasticity enabled highly efficient neuromorphic deep learning achieves better-than-software accuracy

Is a 4-bit synaptic weight resolution enough? - Constraints on enabling spike-timing dependent plasticity in neuromorphic hardware

Digital Biologically Plausible Implementation of Binarized Neural Networks With Differential Hafnium Oxide Resistive Memory Arrays

STDP Based Pruning of Connections and Weight Quantization in Spiking Neural Networks for Energy Efficient Recognition

Small-World Hopfield Neural Networks with Weight Salience Priority and Memristor Synapses for Digit Recognition

1S-1R Array: Pure-memristor Circuit for Binary Neural Networks