Abstract:In analog in‐memory computing systems based on nonvolatile memories such as resistive random‐access memory (RRAM), neural network models are often trained offline and then the weights are programmed onto memory devices as conductance values. The programmed weight values inevitably deviate from the target values during the programming process. This effect can be pronounced for emerging memories such as RRAM, PcRAM, and MRAM due to the stochastic nature during programming. Unlike noise, these weight deviations do not change during inference. The performance of neural network models is investigated against this programming variation under realistic system limitations, including limited device on/off ratios, memory array size, analog‐to‐digital converter (ADC) characteristics, and signed weight representations. Approaches to mitigate such device and circuit nonidealities through architecture‐aware training are also evaluated. The effectiveness of variation injection during training to improve the inference robustness, as well as the effects of different neural network training parameters such as learning rate schedule, will be discussed. In nonvolatile memory‐based analog in‐memory computing systems, variations during device programming can cause neural‐network inference accuracy to degrade since the stored weights will differ from those in the original models. Herein, the performance of deep neural‐network models is investigated against this effect under realistic system limitations, including limited device on/off ratios, memory array size, circuit characteristics, and signed weight representations.

Nonlinear Weight Quantification for Mitigating Read Disturb Effect on Multilevel RRAM-Based Neural Network

The Impact of Non-linear NVM Devices on In-Memory Computing

Robustness of Neuromorphic Computing with RRAM-based Crossbars and Optical Neural Networks.

Nonlinear Quantization for In-Sram Multi-Bit MAC Design

Adaptive Weight Mapping Strategy to Address the Parasitic Effects for ReRAM-based Neural Networks

A Quantized-Weight-Splitting Method of RRAM Arrays for Neuromorphic Applications

Fast and Accurate Weight Updating Strategy for Resistive Random-Access Memory (Rram)-Based Neural Networks

EFFICIENT WEIGHT MAPPING SCHEME WITHOUT VERIFICATION FOR RRAM BASED NEUROMORPHIC COMPUTING

Weighted Synapses Without Carry Operations for RRAM-Based Neuromorphic Systems

Circuit Modeling for RRAM-Based Neuromorphic Chip Crossbar Array with and Without Write-Verify Scheme.

Digital Offset for RRAM-based Neuromorphic Computing: A Novel Solution to Conquer Cycle-to-cycle Variation

Compensation Architecture to Alleviate Noise Effects in RRAM-based Computing-in-memory Chips with Residual Resource

Compensation Architecture Design Utilizing Residual Resource to Mitigate Impacts of Nonidealities in RRAM-based Computing-in-memory Chips

Hardware Implementation Of Rram Based Binarized Neural Networks

On-Chip Write & Verify and Endurance Enhancer Circuits Towards Multi-level RRAM Array

Novel Weight Mapping Method for Reliable NVM based Neural Network

Early-Stage Fluctuation in Low-Power Analog Resistive Memory: Impacts on Neural Network and Mitigation Approach

Investigation of Non-Linear Selection Effect on RRAM Based Neuromorphic Computing Array with Passive Selective Element

Security Enhancement for RRAM Computing System through Obfuscating Crossbar Row Connections

Write–Verify-Free MLC RRAM Using Nonbinary Encoding for AI Weight Storage at the Edge

Device Variation Effects on Neural Network Inference Accuracy in Analog In‐Memory Computing Systems