Abstract:Brain-inspired neuromorphic computing has emerged as a promising solution to overcome the energy and speed limitations of conventional von Neumann architectures. In this context, in-memory computing utilizing memristors has gained attention as a key technology, harnessing their non-volatile characteristics to replicate synaptic behavior akin to the human brain. However, challenges arise from non-linearities, asymmetries, and device variations in memristive devices during synaptic weight updates, leading to inaccurate weight adjustments and diminished recognition accuracy. Moreover, the repetitive weight updates pose endurance challenges for these devices, adversely affecting latency and energy consumption. To address these issues, we propose a Siamese network learning approach to optimize the training of multi-level memristor neural networks. During neural inference, forward propagation takes place within the memristor neural network, enabling error and noise detection in the memristive devices and hardware circuits. Simultaneously, high-precision gradient computation occurs on the software side, initially updating the floating-point weights within the Siamese network with gradients. Subsequently, weight quantization is performed, and the memristor conductance values requiring updates are modified using a sparse update strategy. Additionally, we introduce gradient accumulation and weight quantization error compensation to further enhance network performance. The experimental results of MNIST data recognition, whether based on a MLP or a CNN model, demonstrate the rapid convergence of our network model. Moreover, our method successfully eliminates over 98% of weight updates for memristor conductance weights within a single epoch. This substantial reduction in weight updates leads to a significant decrease in energy consumption and time delay by more than 98% when compared to the basic closed-loop update method. Consequently, this approach effectively addresses the durability requirements of memristive devices.

An Optimization Scheme for Segmented-Memory Neural Network

Learning Quality-aware Dynamic Memory for Video Object Segmentation

Fast Real-Time Video Object Segmentation with a Tangled Memory Network

Spontaneous Temporal Grouping Neural Network for Long-Term Memory Modeling

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

Learning with Memory for Few-Shot Semantic Segmentation

Robust and Efficient Memory Network for Video Object Segmentation

RMem: Restricted Memory Banks Improve Video Object Segmentation

Modulated Memory Network for Video Object Segmentation

Adaptive Memory Management for Video Object Segmentation

Continual learning via region-aware memory

Adaptive Sparse Memory Networks for Efficient and Robust Video Object Segmentation

Video Object Segmentation with Episodic Graph Memory Networks

AutoChunk: Automated Activation Chunk for Memory-Efficient Long Sequence Inference

CmnRec: Sequential Recommendations with Chunk-accelerated Memory Network

Enhancing in-situ updates of quantized memristor neural networks: a Siamese network learning approach

Deep Memory-Augmented Proximal Unrolling Network for Compressive Sensing

A brain-inspired algorithm that mitigates catastrophic forgetting of artificial and spiking neural networks with low computational cost

Pin the Memory: Learning to Generalize Semantic Segmentation

Memory Aware Synapses: Learning what (not) to forget

Progressive Token Length Scaling in Transformer Encoders for Efficient Universal Segmentation