Abstract:The Bayesian Confidence Propagation Neural Network (BCPNN) has been implemented in a way that allows mapping to neural and synaptic processes in the human cortexandhas been used extensively in detailed spiking models of cortical associative memory function and recently also for machine learning applications. In conventional digital implementations of BCPNN, the von Neumann bottleneck is a major challenge with synaptic storage and access to it as the dominant cost. The memristor is a non-volatile device ideal for artificial synapses that fuses computation and storage and thus fundamentally overcomes the von Neumann bottleneck. While the implementation of other neural networks like Spiking Neural Network (SNN) and even Convolutional Neural Network (CNN) on memristor has been studied, the implementation of BCPNN has not. In this paper, the BCPNN learning rule is mapped to a memristor model and implemented with a memristor-based architecture. The implementation of the BCPNN learning rule is a mixed-signal design with the main computation and storage happening in the analog domain. In particular, the nonlinear dopant drift phenomenon of the memristor is exploited to simulate the exponential decay of the synaptic state variables in the BCPNN learning rule. The consistency between the memristor-based solution and the BCPNN learning rule is simulated and verified in Matlab, with a correlation coefficient as high as 0.99. The analog circuit is designed and implemented in the SPICE simulation environment, demonstrating a good emulation effect for the BCPNN learning rule with a correlation coefficient as high as 0.98. This work focuses on demonstrating the feasibility of mapping the BCPNN learning rule to in-circuit computation in memristor. The feasibility of the memristor-based implementation is evaluated and validated in the paper, to pave the way for a more efficient BCPNN implementation, toward a real-time brain emulation engine.

Efficient Memristive Binary Neural Networks with Spatial Separable Convolutions

Memristive KDG-BNN: Memristive binary neural networks trained via knowledge distillation and generative adversarial networks

Design of High Robustness BNN Inference Accelerator Based on Binary Memristors

Efficient Low-Bit Neural Network with Memristor-Based Reconfigurable Circuits

Bayes2IMC: In-Memory Computing for Bayesian Binary Neural Networks

1S-1R Array: Pure-memristor Circuit for Binary Neural Networks

Parallelizing SRAM Arrays with Customized Bit-Cell for Binary Neural Networks

BRoCoM: A Bayesian Framework for Robust Computing on Memristor Crossbar.

Improved Memristive Binarized Neural Networks Using Transformer_DCBNN Architecture with CBAM Attention Mechanism

CiM-BNN:Computing-in-MRAM Architecture for Stochastic Computing Based Bayesian Neural Network

Memristor-Based Binarized Spiking Neural Networks: Challenges and applications

Efficient Training of the Memristive Deep Belief Net Immune to Non-Idealities of the Synaptic Devices

A Variation-Aware Binary Neural Network Framework for Process Resilient In-Memory Computations

Memristive Quantized Neural Networks: A Novel Approach to Accelerate Deep Learning On-Chip.

Long-Term Accuracy Enhancement of Binary Neural Networks Based on Optimized Three-Dimensional Memristor Array

Mapping the BCPNN Learning Rule to a Memristor Model

Energy-Efficient Machine Learning Accelerator for Binary Neural Networks

Area and Energy Efficient Short-Circuit-Logic-Based STT-MRAM Crossbar Array for Binary Neural Networks

A Memristor-Based Spiking Neural Network With High Scalability and Learning Efficiency

Binary Convolutional Neural Network on RRAM.

A Memristive Spiking Neural Network Circuit with Selective Supervised Attention Algorithm