Abstract:In recent years, memristive crossbar-based neuromorphic computing systems (NCS) have provided a promising solution to the acceleration of neural networks. However, stuck-at faults (SAFs) in the memristor devices significantly degrade the computing accuracy of NCS. Besides, the memristor suffers from the process variations, causing deviation of the actual programming resistance from its target resistance. In this paper, we propose a reliability-driven design framework for a memristive crossbar-based NCS in combination with general and chip-specific design optimizations. First, we design a general reliability-aware training scheme to enhance the robustness of NCS to SAFs and device variations; a dropconnect-inspired approach is developed to alleviate the impact of SAFs; a new weighted error function, including cross-entropy error (CEE), the $l_{2}$ -norm of weights, and the sum of squares of first-order derivatives of CEE with respect to weights, is proposed to obtain a smooth error curve, where the effects of variations are suppressed. Second, given the neural network model generated by the reliability-aware training scheme, we exploit chip-specific mapping and re- training to further improve computation accuracy loss incurred by SAFs. Experimental results show that the proposed method can boost the computation accuracy of NCS and improve the NCS robustness. Note to Practitioners—This work is motivated by the manufacturing reliability problem in a memristive crossbar-based NCS. To enhance the robustness of an NCS to SAFs and device variations, this paper presents a reliability-driven design framework with taking account of both general and chip-specific design optimizations. The experimental results have demonstrated that the proposed framework is superior to the prior arts, and can be easily integrated with existing industrial hardware-based fault tolerance solutions for higher accuracy at lower overhead. Memristive crossbar-based computing system gives hope for the anticipated efficient implementation of artificial neuromorphic networks. With the help of the reliability-driven designs, the computation accuracy is restored, and hence we can expect the wide use of memristive crossbar-based computing system in neuromorphic computing applications.

Efficient neuro-fuzzy system and its Memristor Crossbar-based Hardware Implementation

Neuro-Fuzzy Computing System with the Capacity of Implementation on Memristor-Crossbar and Optimization-Free Hardware Training

Using memristor crossbar structure to implement a novel adaptive real time fuzzy modeling algorithm

Stochastic neuro-fuzzy system implemented in memristor crossbar arrays

Aging Aware Retraining for Memristor-based Neuromorphic Computing

Reliable Memristor-based Neuromorphic Design Using Variation- and Defect-Aware Training

Design and Implementation of a Flexible Neuromorphic Computing System for Affective Communication Via Memristive Circuits

Memristive Fuzzy Deep Learning Systems

An FPGA-based Memristor Emulator for Artificial Neural Network.

A novel adaptive learning algorithm for low-dimensional feature space using memristor-crossbar implementation and on-chip training

An Efficient Programming Framework for Memristor-based Neuromorphic Computing

A Fully Hardware-Based Memristive Multilayer Neural Network

Hardware implementation of memristor-based artificial neural networks

Memristor-based Synapse Design and a Case Study in Reconfigurable Systems

A Brain-inspired Fully Hardware Hopfield Neural Network Based on Memristive Arrays.

Memristor-based Neuromorphic Implementations for Artificial Neural Networks

An Overview On Memristor Crossabr Based Neuromorphic Circuit And Architecture

Tolerance of Intrinsic Device Variation in Fuzzy Restricted Boltzmann Machine Network Based on Memristive Nano-Synapses

Implementation of Multilayer Perceptron Network with Highly Uniform Passive Memristive Crossbar Circuits

A fully integrated reprogrammable memristor–CMOS system for efficient multiply–accumulate operations

Reliability-Driven Memristive Crossbar Design in Neuromorphic Computing Systems