Abstract:Bayesian Neural Networks (BNNs) provide superior estimates of uncertainty by generating an ensemble of predictive distributions. However, inference via ensembling is resource-intensive, requiring additional entropy sources to generate stochasticity which increases resource consumption. We introduce Bayes2IMC, an in-memory computing (IMC) architecture designed for binary Bayesian neural networks that leverage nanoscale device stochasticity to generate desired distributions. Our novel approach utilizes Phase-Change Memory (PCM) to harness inherent noise characteristics, enabling the creation of a binary neural network. This design eliminates the necessity for a pre-neuron Analog-to-Digital Converter (ADC), significantly improving power and area efficiency. We also develop a hardware-software co-optimized correction method applied solely on the logits in the final layer to reduce device-induced accuracy variations across deployments on hardware. Additionally, we devise a simple compensation technique that ensures no drop in classification accuracy despite conductance drift of PCM. We validate the effectiveness of our approach on the CIFAR-10 dataset with a VGGBinaryConnect model, achieving accuracy metrics comparable to ideal software implementations as well as results reported in the literature using other technologies. Finally, we present a complete core architecture and compare its projected power, performance, and area efficiency against an equivalent SRAM baseline, showing a $3.8$ to $9.6 \times$ improvement in total efficiency (in GOPS/W/mm$^2$) and a $2.2 $ to $5.6 \times$ improvement in power efficiency (in GOPS/W). In addition, the projected hardware performance of Bayes2IMC surpasses that of most of the BNN architectures based on memristive devices reported in the literature, and achieves up to $20\%$ higher power efficiency compared to the state-of-the-art.

CORN: In-Buffer Computing for Binary Neural Network

A Low-Power In-Memory Multiplication and Accumulation Array with Modified Radix-4 Input and Canonical Signed Digit Weights

A Robust 8-Bit Non-Volatile Computing-in-Memory Core for Low-Power Parallel MAC Operations.

DaDianNao: A Machine-Learning Supercomputer

Parapim: A Parallel Processing-In-Memory Accelerator For Binary-Weight Deep Neural Networks

Bayes2IMC: In-Memory Computing for Bayesian Binary Neural Networks

CMP-PIM: An Energy-Efficient Comparator-based Processing-In-Memory Neural Network Accelerator

Hadamard Product-Based In-Memory Computing Design for Floating Point Neural Network Training

A Multilevel Cell STT-MRAM-Based Computing In-Memory Accelerator for Binary Convolutional Neural Network

A Universal RRAM-Based DNN Accelerator with Programmable Crossbars Beyond MVM Operator

BR-CIM: an Efficient Binary Representation Computation-In-Memory Design

A Hybrid Precision Low Power Computing-in-memory Architecture for Neural Networks

Xcel-RAM: Accelerating Binary Neural Networks in High-Throughput SRAM Compute Arrays

An Energy-Efficient Floating-Point Compute SRAM with Pipelined In-Memory Bit-Parallel Exponent and Bitwise Mantissa Processing

Accelerating Neural Network Inference with Processing-in-DRAM: From the Edge to the Cloud

SOT-MRAM-Based Design for Energy-Efficient and Reliable Binary Neural Network Acceleration

Neural-PIM: Efficient Processing-In-Memory with Neural Approximation of Peripherals

A Digital SRAM Computing-in-Memory Design Utilizing Activation Unstructured Sparsity for High-Efficient DNN Inference

High-Throughput In-Memory Computing for Binary Deep Neural Networks with Monolithically Integrated RRAM and 90nm CMOS

IMCE: Energy-efficient Bit-Wise In-Memory Convolution Engine for Deep Neural Network

DAM SRAM CORE: An Efficient High-Speed and Low-Power CIM SRAM CORE Design for Feature Extraction Convolutional Layers in Binary Neural Networks