Abstract:In recent years, memristive crossbar-based neuromorphic computing systems (NCS) have provided a promising solution to the acceleration of neural networks. However, stuck-at faults (SAFs) in the memristor devices significantly degrade the computing accuracy of NCS. Besides, the memristor suffers from the process variations, causing deviation of the actual programming resistance from its target resistance. In this paper, we propose a reliability-driven design framework for a memristive crossbar-based NCS in combination with general and chip-specific design optimizations. First, we design a general reliability-aware training scheme to enhance the robustness of NCS to SAFs and device variations; a dropconnect-inspired approach is developed to alleviate the impact of SAFs; a new weighted error function, including cross-entropy error (CEE), the $l_{2}$ -norm of weights, and the sum of squares of first-order derivatives of CEE with respect to weights, is proposed to obtain a smooth error curve, where the effects of variations are suppressed. Second, given the neural network model generated by the reliability-aware training scheme, we exploit chip-specific mapping and re- training to further improve computation accuracy loss incurred by SAFs. Experimental results show that the proposed method can boost the computation accuracy of NCS and improve the NCS robustness. Note to Practitioners—This work is motivated by the manufacturing reliability problem in a memristive crossbar-based NCS. To enhance the robustness of an NCS to SAFs and device variations, this paper presents a reliability-driven design framework with taking account of both general and chip-specific design optimizations. The experimental results have demonstrated that the proposed framework is superior to the prior arts, and can be easily integrated with existing industrial hardware-based fault tolerance solutions for higher accuracy at lower overhead. Memristive crossbar-based computing system gives hope for the anticipated efficient implementation of artificial neuromorphic networks. With the help of the reliability-driven designs, the computation accuracy is restored, and hence we can expect the wide use of memristive crossbar-based computing system in neuromorphic computing applications.

Research progress on solutions to the sneak path issue in memristor crossbar arrays

Recent Progress in Memrsitor Array Structures and Solutions for Sneak Path Current Reduction

Post-Moore Memory Technology: Sneak Path Current (SPC) Phenomena on RRAM Crossbar Array and Solutions

Latency Insertion Method for Accelerated Simulation of Memristor Crossbar Array in Neuromorphic Chip

Modeling and Analysis of a Large-Scale Memristor Crossbar Array for Neuromorphic Chip

Circuit Modeling for RRAM-Based Neuromorphic Chip Crossbar Array with and Without Write-Verify Scheme.

Assessment of functional performance in self-rectifying passive crossbar arrays utilizing sneak path current

Research Progress on Memristor: From Synapses to Computing Systems

Electromagentic Impact of Parasitic Effects on the STDP Characteristics in Neuromorphic Memristor Crossbar Arrays

Analyzing the Influence of Parasitic Effects on Memristor STDP with the PEEC Method

Reliability-Driven Memristive Crossbar Design in Neuromorphic Computing Systems

Signal Integrity Analysis for Resistive Random Access Memory Crossbar Array by Compact Model with Consideration of Electro-Thermal Coupling Effects

Self-rectifying resistive switching in MAPbI3-based memristor device

Memristive Architectures Exploiting Self-Compliance Multilevel Implementation on 1 kb Crossbar Arrays for Online and Offline Learning Neuromorphic Applications

Higher order neural processing with input-adaptive dynamic weights on MoS2 memtransistor crossbars

An Efficient Programming Framework for Memristor-based Neuromorphic Computing

Modeling and Signal Integrity Analysis of RRAM-Based Neuromorphic Chip Crossbar Array Using Partial Equivalent Element Circuit (PEEC) Method

Mitigating State-Drift in Memristor Crossbar Arrays for Vector Matrix Multiplication

Long short-term memory networks in memristor crossbar arrays

Progress in Rectifying-Based RRAM Passive Crossbar Array

Novel 3D Horizontal RRAM Architecture with Isolation Cell Structure for Sneak Current Depression.