Abstract:Memristor-enabled neuromorphic computing systems provide a fast and energy-efficient approach to training neural networks<a href="#ref-CR1">1</a>,<a href="#ref-CR2">2</a>,<a href="#ref-CR3">3</a>,<a href="/articles/s41586-020-1942-4#ref-CR4">4</a>. However, convolutional neural networks (CNNs)—one of the most important models for image recognition<a href="/articles/s41586-020-1942-4#ref-CR5">5</a>—have not yet been fully hardware-implemented using memristor crossbars, which are cross-point arrays with a memristor device at each intersection. Moreover, achieving software-comparable results is highly challenging owing to the poor yield, large variation and other non-ideal characteristics of devices<a href="#ref-CR6">6</a>,<a href="#ref-CR7">7</a>,<a href="#ref-CR8">8</a>,<a href="/articles/s41586-020-1942-4#ref-CR9">9</a>. Here we report the fabrication of high-yield, high-performance and uniform memristor crossbar arrays for the implementation of CNNs, which integrate eight 2,048-cell memristor arrays to improve parallel-computing efficiency. In addition, we propose an effective hybrid-training method to adapt to device imperfections and improve the overall system performance. We built a five-layer memristor-based CNN to perform MNIST<a href="/articles/s41586-020-1942-4#ref-CR10">10</a> image recognition, and achieved a high accuracy of more than 96 per cent. In addition to parallel convolutions using different kernels with shared inputs, replication of multiple identical kernels in memristor arrays was demonstrated for processing different inputs in parallel. The memristor-based CNN neuromorphic system has an energy efficiency more than two orders of magnitude greater than that of state-of-the-art graphics-processing units, and is shown to be scalable to larger networks, such as residual neural networks. Our results are expected to enable a viable memristor-based non-von Neumann hardware solution for deep neural networks and edge computing.

Energy-Efficient Brain Floating Point Convolutional Neural Network Using Memristors

A Low-Power In-Memory Multiplication and Accumulation Array with Modified Radix-4 Input and Canonical Signed Digit Weights

Fully hardware-implemented memristor convolutional neural network

A 28-nm 64-kb 31.6-TFLOPS/W Digital-Domain Floating-Point-Computing-Unit and Double-Bit 6T-SRAM Computing-in-Memory Macro for Floating-Point CNNs

APIM: An Antiferromagnetic MRAM-Based Processing-In-Memory System for Efficient Bit-level Operations of Quantized Convolutional Neural Networks

A 1.97 TFLOPS/W Configurable SRAM-Based Floating-Point Computation-in-Memory Macro for Energy-Efficient AI Chips.

An efficient full-size convolutional computing method based on memristor crossbar

Pruning and quantization algorithm with applications in memristor-based convolutional neural network

An Energy-Efficient Mixed-Bit CNN Accelerator With Column Parallel Readout for ReRAM-Based In-Memory Computing

A Memory-Optimized and Energy-Efficient CNN Acceleration Architecture Based on FPGA.

An Energy-Efficient Floating-Point Compute SRAM with Pipelined In-Memory Bit-Parallel Exponent and Bitwise Mantissa Processing

AFPR-CIM: An Analog-Domain Floating-Point RRAM-based Compute-In-Memory Architecture with Dynamic Range Adaptive FP-ADC

A Hybrid Precision Low Power Computing-in-memory Architecture for Neural Networks

Performance estimation for the memristor-based computing-in-memory implementation of extremely factorized network for real-time and low-power semantic segmentation

Switched by input: power efficient structure for RRAM-based convolutional neural network.

Training Low Bitwidth Convolutional Neural Network on RRAM

Memristor-based in-situ convolutional strategy for accurate braille recognition

FPIRM: Floating-point Processing in Racetrack Memories

A 19.7 TFLOPS/W Multiply-less Logarithmic Floating-Point CIM Architecture with Error-Reduced Compensated Approximate Adder

Memristor‐Based Analog Computation and Neural Network Classification with a Dot Product Engine

A Multiply-Less Approximate SRAM Compute-In-Memory Macro for Neural-Network Inference