Abstract:Brain-inspired neuromorphic computing has emerged as a promising solution to overcome the energy and speed limitations of conventional von Neumann architectures. In this context, in-memory computing utilizing memristors has gained attention as a key technology, harnessing their non-volatile characteristics to replicate synaptic behavior akin to the human brain. However, challenges arise from non-linearities, asymmetries, and device variations in memristive devices during synaptic weight updates, leading to inaccurate weight adjustments and diminished recognition accuracy. Moreover, the repetitive weight updates pose endurance challenges for these devices, adversely affecting latency and energy consumption. To address these issues, we propose a Siamese network learning approach to optimize the training of multi-level memristor neural networks. During neural inference, forward propagation takes place within the memristor neural network, enabling error and noise detection in the memristive devices and hardware circuits. Simultaneously, high-precision gradient computation occurs on the software side, initially updating the floating-point weights within the Siamese network with gradients. Subsequently, weight quantization is performed, and the memristor conductance values requiring updates are modified using a sparse update strategy. Additionally, we introduce gradient accumulation and weight quantization error compensation to further enhance network performance. The experimental results of MNIST data recognition, whether based on a MLP or a CNN model, demonstrate the rapid convergence of our network model. Moreover, our method successfully eliminates over 98% of weight updates for memristor conductance weights within a single epoch. This substantial reduction in weight updates leads to a significant decrease in energy consumption and time delay by more than 98% when compared to the basic closed-loop update method. Consequently, this approach effectively addresses the durability requirements of memristive devices.

High-Precision Symmetric Weight Update of Memristor by Gate Voltage Ramping Method for Convolutional Neural Network Accelerator

Reliable Memristor-based Neuromorphic Design Using Variation- and Defect-Aware Training

Strategies to Improve the Accuracy of Memristor-Based Convolutional Neural Networks

In Situ Training of Feed-Forward and Recurrent Convolutional Memristor Networks

Design for Enhancing the Performance of Memristive Convolution Neural Network

Memristor-based neural networks with weight simultaneous perturbation training

Enhancing in-situ updates of quantized memristor neural networks: a Siamese network learning approach

Improvement of the Symmetry and Linearity of Synaptic Weight Update by Combining the InGaZnO Synaptic Transistor and Memristor

Hybrid Dual-Complementary Metal-Oxide-semiconductor/memristor Synapse-Based Neural Network with Its Applications in Image Super-Resolution

Reduction 93.7% time and power consumption using a memristor-based imprecise gradient update algorithm

Memristor Based Spiking Neural Network Accelerator Architecture

SSM: a High-Performance Scheme for in Situ Training of Imprecise Memristor Neural Networks

Fast and Accurate Weight Updating Strategy for Resistive Random-Access Memory (Rram)-Based Neural Networks

A Memristor-Based Neural Network Circuit with Synchronous Weight Adjustment.

A Closed-Loop Design to Enhance Weight Stability of Memristor Based Neural Network Chips

Accelerator-friendly neural-network training: Learning variations and defects in RRAM crossbar.

Training Itself: Mixed-signal Training Acceleration for Memristor-Based Neural Network

An efficient full-size convolutional computing method based on memristor crossbar

Design of High Robustness BNN Inference Accelerator Based on Binary Memristors

An Efficient and Accurate Memristive Memory for Array-based Spiking Neural Networks

Simulation of In-Situ Training in Spike Neural Network Based on Non-Ideal Memristors