Abstract:Deep convolutional neural networks (DCNNs) have achieved state-of-the-art performance in classification, natural language processing (NLP), and regression tasks. However, there is still a great gap between DCNNs and the human brain in terms of computation efficiency. Inspired by neural synaptic plasticity and stochastic computing (SC), we propose neural synaptic plasticity-inspired computing (NSPC) to simulate the human brain's neural network activity for inference tasks with simple logic gates. The multiplication and accumulation (MAC) is transformed by the wire connectivity in NSPC, which only requires bundles of wires and small width adders. To this end, the NSPC imitates the structure of neural synaptic plasticity from a circuit wires connection perspective. Furthermore, from the principle of NSPC, we use a data mapping method to convert the convolution operations to matrix multiplications. Based on the methodology of NSPC, fully-pipelined and low latency architecture is designed. The proposed NSPC accelerator exhibits high hardware efficiency while maintaining a comparable network accuracy level. The NSPC based DCNN accelerator (NSPC-CNN) processes DCNN at $1.5625M$ images/ $s$ with a power dissipation of $15.42~W$ and an area of $36.4~mm^{2}$ . The NSPC based deep neural network (DNN) accelerator (NSPC-DNN) that implements three fully connected layers DNN consumes only $6.6~mm^{2}$ area and $2.93~W$ power, and achieves a throughput of $400M$ -images/ $s$ . Compared with conventional fixed-point implementations, the NSPC-CNN achieves $2.77 times $ area efficiency, $2.25 times $ power efficiency; the proposed NSPC-DNN exhibits $2.31 times $ area efficiency and $2.09 times $ power efficiency.

HNMC: Hybrid Near-Memory Computing Circuit for Neural Network Acceleration

A Near Memory Computing FPGA Architecture for Neural Network Acceleration

A Low-Power In-Memory Multiplication and Accumulation Array with Modified Radix-4 Input and Canonical Signed Digit Weights

DaDianNao: A Machine-Learning Supercomputer

In‐memory Calculation with Embedded Arithmetic and Logic Units for Deep Neural Network

An Energy-Efficient Computing-in-Memory circuit based on Multiplexing-Computing-Cell for BNN acceleration

HSC: A Hybrid Spin/CMOS Logic Based In-Memory Engine with Area-Efficient Mapping Strategy.

Neural Synaptic Plasticity-Inspired Computing: A High Computing Efficient Deep Convolutional Neural Network Accelerator

A Computing In-Memory Multibit Multiplication Based on Decoupling and In-Array Storing

An 8-Bit RRAM Based Multiplier for Hybrid Memory Computing

Look-Up Table based Neural Network Hardware

Fast, Scalable, Energy-Efficient Non-element-wise Matrix Multiplication on FPGA

A Hybrid Precision Low Power Computing-in-memory Architecture for Neural Networks

A Communication-Aware DNN Accelerator on ImageNet Using In-Memory Entry-Counting Based Algorithm-Circuit-Architecture Co-Design in 65-nm CMOS

Hardware Efficient Reconfigurable Logic-in-Memory Circuit Based Neural Network Computing.

An IMPLY-based Memristive Multiplier for Computing-in-Memory Systems with Weight-Stationary CNN Acceleration

LUTMUL: Exceed Conventional FPGA Roofline Limit by LUT-based Efficient Multiplication for Neural Network Inference

An In-Memory Computing Multiply-and-accumulate Circuit Based on Ternary STT-MRAMs for Convolutional Neural Networks.

A 3d Multi-Layer Cmos-Rram Accelerator for Neural Network

A Multiply-Less Approximate SRAM Compute-In-Memory Macro for Neural-Network Inference

An In-memory Booth Multiplier Based on Non-volatile Memory for Neural Network Applications.