Abstract:Brain-inspired neuromorphic computing has emerged as a promising solution to overcome the energy and speed limitations of conventional von Neumann architectures. In this context, in-memory computing utilizing memristors has gained attention as a key technology, harnessing their non-volatile characteristics to replicate synaptic behavior akin to the human brain. However, challenges arise from non-linearities, asymmetries, and device variations in memristive devices during synaptic weight updates, leading to inaccurate weight adjustments and diminished recognition accuracy. Moreover, the repetitive weight updates pose endurance challenges for these devices, adversely affecting latency and energy consumption. To address these issues, we propose a Siamese network learning approach to optimize the training of multi-level memristor neural networks. During neural inference, forward propagation takes place within the memristor neural network, enabling error and noise detection in the memristive devices and hardware circuits. Simultaneously, high-precision gradient computation occurs on the software side, initially updating the floating-point weights within the Siamese network with gradients. Subsequently, weight quantization is performed, and the memristor conductance values requiring updates are modified using a sparse update strategy. Additionally, we introduce gradient accumulation and weight quantization error compensation to further enhance network performance. The experimental results of MNIST data recognition, whether based on a MLP or a CNN model, demonstrate the rapid convergence of our network model. Moreover, our method successfully eliminates over 98% of weight updates for memristor conductance weights within a single epoch. This substantial reduction in weight updates leads to a significant decrease in energy consumption and time delay by more than 98% when compared to the basic closed-loop update method. Consequently, this approach effectively addresses the durability requirements of memristive devices.

Memristor-Based Circuit Design for Multilayer Neural Networks

Hybrid Dual-Complementary Metal-Oxide-semiconductor/memristor Synapse-Based Neural Network with Its Applications in Image Super-Resolution

Memristor Neural Network Design

A Circuit-Based Learning Architecture for Multilayer Neural Networks With Memristor Bridge Synapses

A neural network circuit with associative learning and forgetting process based on memristor neuromorphic device

A Memristor Neural Network Based on Simple Logarithmic-Sigmoidal Transfer Function with MOS Transistors

A Memristor Neural Network Using Synaptic Plasticity and Its Associative Memory

Overview of Memristor-Based Neural Network Design and Applications

In Situ Training of Feed-Forward and Recurrent Convolutional Memristor Networks

General memristor with applications in multilayer neural networks

An Overview On Memristor Crossabr Based Neuromorphic Circuit And Architecture

A Self-Rectification and Quasi-Linear Analogue Memristor for Artificial Neural Networks

Enhancing in-situ updates of quantized memristor neural networks: a Siamese network learning approach

Efficient and self-adaptive in-situ learning in multilayer memristor neural networks

Memristor-Based Cellular Nonlinear/Neural Network: Design, Analysis, and Applications

Memristive Logic Design of Multifunctional Spiking Neural Network with Unsupervised Learning

An Investigation into Neuromorphic ICs using Memristor-CMOS Hybrid Circuits

Li-Ion Doped Artificial Synaptic Memristor for Highly Linear Neuromorphic Computing

The Ouroboros of Memristors: Neural Networks Facilitating Memristor Programming

Essential Characteristics of Memristors for Neuromorphic Computing

Design of Artificial Neurons of Memristive Neuromorphic Networks Based on Biological Neural Dynamics and Structures