Abstract:Deep neural networks are a biologically-inspired class of algorithms that have recently demonstrated state-of-the-art accuracies involving large-scale classification and recognition tasks. Indeed, a major landmark that enables efficient hardware accelerators for deep networks is the recent advances from the machine learning community that have demonstrated aggressively scaled deep binary networks with state-of-the-art accuracies. In this paper, we demonstrate how deep binary networks can be accelerated in modified von-Neumann machines by enabling binary convolutions within the SRAM array. In general, binary convolutions consist of bit-wise XNOR followed by a population-count (popcount). We present a charge sharing XNOR and popcount operation in 10 transistor SRAM cells. We have employed multiple circuit techniques including dual-read-worldines (Dual-RWL) along with a dual-stage ADC that overcomes the inaccuracies of a low precision ADC, to achieve a fairly accurate popcount. In addition, a key highlight of the present work is the fact that we propose sectioning of the SRAM array by adding switches onto the read-bitlines, thereby achieving improved parallelism. This is beneficial for deep networks, where the kernel size grows and requires to be stored in multiple sub-banks. As such, one needs to evaluate the partial popcount from multiple sub-banks and sum them up for achieving the final popcount. For n-sections per sub-array, we can perform n convolutions within one particular sub-bank, thereby improving overall system throughput as well as the energy efficiency. Our results at the array level show that the energy consumption and delay per-operation was 1.914pJ and 45ns, respectively. Moreover, an energy improvement of 2.5x, and a performance improvement of 4x was achieved by using the proposed sectioned-SRAM, compared to a non-sectioned SRAM design.

An Improved Hardware Accelaration Architecture of Binary Neural Network With 1T1R Array Based Forward/Backward Propagation Module

An Improved RRAM-Based Binarized Neural Network with High Variation-Tolerated Forward/Backward Propagation Module

Hardware Implementation Of Rram Based Binarized Neural Networks

Energy-Efficient Machine Learning Accelerator for Binary Neural Networks

Rram-Based Binary Neural Networks Using Back-Propagation Learning

Binary Convolutional Neural Network on RRAM.

Neural Network-Hardware Co-design for Scalable RRAM-based BNN Accelerators

Parallelizing SRAM Arrays with Customized Bit-Cell for Binary Neural Networks

A Universal RRAM-Based DNN Accelerator with Programmable Crossbars Beyond MVM Operator

Enabling Resistive-RAM-based Activation Functions for Deep Neural Network Acceleration

Area Efficient Pattern Representation of Binary Neural Networks on RRAM

BasisN: Reprogramming-Free RRAM-Based In-Memory-Computing by Basis Combination for Deep Neural Networks

A 3d Multi-Layer Cmos-Rram Accelerator for Neural Network

Low Bit-Width Convolutional Neural Network on RRAM

Bit-Transformer: Transforming Bit-level Sparsity into Higher Preformance in ReRAM-based Accelerator

Inner Product Accelerating Scheme Based on RRAM Array for Attention-Mechanism Neural Network

A New Hardware Implementation Approach Of Bnns Based On Nonlinear 2t2r Synaptic Cell

Binary Neural Network with 16 Mb Rram Macro Chip for Classification and Online Training

A Reduced Architecture for ReRAM-Based Neural Network Accelerator and Its Software Stack

Design of High Robustness BNN Inference Accelerator Based on Binary Memristors

Xcel-RAM: Accelerating Binary Neural Networks in High-Throughput SRAM Compute Arrays