Abstract:A number of recent efforts have attempted to design accelerators for popular machine learning algorithms, such as those involving convolutional and deep neural networks (CNNs and DNNs). These algorithms typically involve a large number of multiply-accumulate (dot-product) operations. A recent project, DaDianNao, adopts a near data processing approach, where a specialized neural functional unit performs all the digital arithmetic operations and receives input weights from adjacent eDRAM banks. This work explores an in-situ processing approach, where memristor crossbar arrays not only store input weights, but are also used to perform dot-product operations in an analog manner. While the use of crossbar memory as an analog dot-product engine is well known, no prior work has designed or characterized a full-fledged accelerator based on crossbars. In particular, our work makes the following contributions: (i) We design a pipelined architecture, with some crossbars dedicated for each neural network layer, and eDRAM buffers that aggregate data between pipeline stages. (ii) We define new data encoding techniques that are amenable to analog computations and that can reduce the high overheads of analog-to-digital conversion (ADC). (iii) We define the many supporting digital components required in an analog CNN accelerator and carry out a design space exploration to identify the best balance of memristor storage/compute, ADCs, and eDRAM storage on a chip. On a suite of CNN and DNN workloads, the proposed ISAAC architecture yields improvements of 14.8, 5.5, and 7.5 in throughput, energy, and computational density (respectively), relative to the state-of-the-art DaDianNao architecture.

AEPE: an Area and Power Efficient RRAM Crossbar-Based Accelerator for Deep CNNs

A Convolutional Neural Network Accelerator Architecture with Fine-Granular Mixed Precision Configurability.

RRAM Based Buffer Design for Energy Efficient CNN Accelerator.

An Energy-Efficient Mixed-Bit CNN Accelerator With Column Parallel Readout for ReRAM-Based In-Memory Computing

High Area/Energy Efficiency RRAM CNN Accelerator with Pattern-Pruning-Based Weight Mapping Scheme

A 1T2R1C ReRAM CIM Accelerator with Energy-Efficient Voltage Division and Capacitive Coupling for CNN Acceleration in AI Edge Applications.

A Configurable Multi-Precision CNN Computing Framework Based on Single Bit RRAM

Low Bit-Width Convolutional Neural Network on RRAM

Mixed Size Crossbar Based RRAM CNN Accelerator with Overlapped Mapping Method

Switched by input: power efficient structure for RRAM-based convolutional neural network.

RRAM-DNN: an RRAM and Model-Compression Empowered All-Weights-On-Chip DNN Accelerator

LayCO: Achieving Least Lossy Accuracy for Most Efficient RRAM-Based Deep Neural Network Accelerator via Layer-Centric Co-Optimization

An Energy Efficient Computing-in-Memory Accelerator With 1T2R Cell and Fully Analog Processing for Edge AI Applications

RANA: Towards Efficient Neural Acceleration with Refresh-Optimized Embedded DRAM

A Low-Latency DNN Accelerator Enabled by DFT-Based Convolution Execution Within Crossbar Arrays

A High Efficient Architecture for Convolution Neural Network Accelerator

Training Low Bitwidth Convolutional Neural Network on RRAM

Design of a Convolutional Neural Network Accelerator Based on On-Chip Data Reordering

An Area-Efficient CNN Accelerator Supporting Global Average Pooling with Arbitrary Shapes

Energy-Efficient Architecture for FPGA-based Deep Convolutional Neural Networks with Binary Weights

ISAAC: A Convolutional Neural Network Accelerator with In-Situ Analog Arithmetic in Crossbars