Abstract:Memristor-enabled neuromorphic computing systems provide a fast and energy-efficient approach to training neural networks<a href="#ref-CR1">1</a>,<a href="#ref-CR2">2</a>,<a href="#ref-CR3">3</a>,<a href="/articles/s41586-020-1942-4#ref-CR4">4</a>. However, convolutional neural networks (CNNs)—one of the most important models for image recognition<a href="/articles/s41586-020-1942-4#ref-CR5">5</a>—have not yet been fully hardware-implemented using memristor crossbars, which are cross-point arrays with a memristor device at each intersection. Moreover, achieving software-comparable results is highly challenging owing to the poor yield, large variation and other non-ideal characteristics of devices<a href="#ref-CR6">6</a>,<a href="#ref-CR7">7</a>,<a href="#ref-CR8">8</a>,<a href="/articles/s41586-020-1942-4#ref-CR9">9</a>. Here we report the fabrication of high-yield, high-performance and uniform memristor crossbar arrays for the implementation of CNNs, which integrate eight 2,048-cell memristor arrays to improve parallel-computing efficiency. In addition, we propose an effective hybrid-training method to adapt to device imperfections and improve the overall system performance. We built a five-layer memristor-based CNN to perform MNIST<a href="/articles/s41586-020-1942-4#ref-CR10">10</a> image recognition, and achieved a high accuracy of more than 96 per cent. In addition to parallel convolutions using different kernels with shared inputs, replication of multiple identical kernels in memristor arrays was demonstrated for processing different inputs in parallel. The memristor-based CNN neuromorphic system has an energy efficiency more than two orders of magnitude greater than that of state-of-the-art graphics-processing units, and is shown to be scalable to larger networks, such as residual neural networks. Our results are expected to enable a viable memristor-based non-von Neumann hardware solution for deep neural networks and edge computing.

A Multilayer Neural Network Merging Image Preprocessing and Pattern Recognition by Integrating Diffusion and Drift Memristors

Fully memristive spiking-neuron learning framework and its applications on pattern recognition and edge detection

Hybrid Dual-Complementary Metal-Oxide-semiconductor/memristor Synapse-Based Neural Network with Its Applications in Image Super-Resolution

A General Memristor-Based Pulse Coupled Neural Network with Variable Linking Coefficient for Multi-Focus Image Fusion

In Situ Training of Feed-Forward and Recurrent Convolutional Memristor Networks

Memristor-Based Circuit Design for Multilayer Neural Networks

A Brain-Inspired In-Memory Computing System for Neuronal Communication Via Memristive Circuits.

Memristive System Based Image Processing Technology: A Review and Perspective

Efficient and self-adaptive in-situ learning in multilayer memristor neural networks

Implementation of Multilayer Perceptron Network with Highly Uniform Passive Memristive Crossbar Circuits

Fully memristive neural networks for pattern classification with unsupervised learning

In-situ learning in multilayer locally-connected memristive spiking neural network

Fully hardware-implemented memristor convolutional neural network

A Quantized Convolutional Neural Network Implemented with Memristor for Image Denoising and Recognition.

In-situ Learning in Hardware Compatible Multi-layer Memristive Spiking Neural Network

Dynamic neural network with memristive CIM and CAM for 2D and 3D vision

A Hardware Friendly Unsupervised Memristive Neural Network with Weight Sharing Mechanism

A Memristors-Based Dendritic Neuron for High-Efficiency Spatial-Temporal Information Processing.

Complementary Memtransistor-Based Multilayer Neural Networks for Online Supervised Learning Through (Anti-)Spike-Timing-Dependent Plasticity

Cross-layer transmission realized by light-emitting memristor for constructing ultra-deep neural network with transfer learning ability

Deep Learning in Memristive Nanowire Networks