Abstract:In recent years, memristive crossbar-based neuromorphic computing systems (NCS) have provided a promising solution to the acceleration of neural networks. However, stuck-at faults (SAFs) in the memristor devices significantly degrade the computing accuracy of NCS. Besides, the memristor suffers from the process variations, causing deviation of the actual programming resistance from its target resistance. In this paper, we propose a reliability-driven design framework for a memristive crossbar-based NCS in combination with general and chip-specific design optimizations. First, we design a general reliability-aware training scheme to enhance the robustness of NCS to SAFs and device variations; a dropconnect-inspired approach is developed to alleviate the impact of SAFs; a new weighted error function, including cross-entropy error (CEE), the $l_{2}$ -norm of weights, and the sum of squares of first-order derivatives of CEE with respect to weights, is proposed to obtain a smooth error curve, where the effects of variations are suppressed. Second, given the neural network model generated by the reliability-aware training scheme, we exploit chip-specific mapping and re- training to further improve computation accuracy loss incurred by SAFs. Experimental results show that the proposed method can boost the computation accuracy of NCS and improve the NCS robustness. Note to Practitioners—This work is motivated by the manufacturing reliability problem in a memristive crossbar-based NCS. To enhance the robustness of an NCS to SAFs and device variations, this paper presents a reliability-driven design framework with taking account of both general and chip-specific design optimizations. The experimental results have demonstrated that the proposed framework is superior to the prior arts, and can be easily integrated with existing industrial hardware-based fault tolerance solutions for higher accuracy at lower overhead. Memristive crossbar-based computing system gives hope for the anticipated efficient implementation of artificial neuromorphic networks. With the help of the reliability-driven designs, the computation accuracy is restored, and hence we can expect the wide use of memristive crossbar-based computing system in neuromorphic computing applications.

Computation-oriented Fault-Tolerance Schemes for RRAM Computing Systems

Stuck-at Fault Tolerance in RRAM Computing Systems.

Fault Tolerance for RRAM-Based Matrix Operations

Algorithmic Fault Detection for RRAM-based Matrix Operations

Hardware Fault Tolerance for Binary RRAM Crossbars

Fault-Tolerant Training Enabled by On-Line Fault Detection for RRAM-Based Neural Computing Systems

Fault-Tolerant Training with On-Line Fault Detection for RRAM-Based Neural Computing Systems

Rescuing RRAM-Based Computing from Static and Dynamic Faults

Bit-Aware Fault-Tolerant Hybrid Retraining and Remapping Schemes for RRAM-Based Computing-in-Memory Systems

Technological Exploration of Rram Crossbar Array for Matrix-Vector Multiplication

Reliability-Driven Memristive Crossbar Design in Neuromorphic Computing Systems

Device and Circuit Interaction Analysis of Stochastic Behaviors in Cross-Point RRAM Arrays

Programming Strategy Optimization of RRAM Fabricated by 28 nm Standard CMOS Process

3-D Resistive Memory Arrays: from Intrinsic Switching Behaviors to Optimization Guidelines

On the Use of Dram with Unrepaired Weak Cells in Computing Systems

Statistical assessment methodology for the design and optimization of cross-point RRAM arrays

System and Technology Co-optimization for RRAM Based Computation-in-memory Chip

MErging the Interface: Power, Area and Accuracy Co-Optimization for RRAM Crossbar-Based Mixed-Signal Computing System

Rescuing Memristor-Based Computing with Non-Linear Resistance Levels.

Self-Terminating Write of Multi-Level Cell ReRAM for Efficient Neuromorphic Computing

Reliability-Driven Neuromorphic Computing Systems Design.