Abstract:Deep convolutional neural networks (DCNNs) have achieved state-of-the-art performance in classification, natural language processing (NLP), and regression tasks. However, there is still a great gap between DCNNs and the human brain in terms of computation efficiency. Inspired by neural synaptic plasticity and stochastic computing (SC), we propose neural synaptic plasticity-inspired computing (NSPC) to simulate the human brain's neural network activity for inference tasks with simple logic gates. The multiplication and accumulation (MAC) is transformed by the wire connectivity in NSPC, which only requires bundles of wires and small width adders. To this end, the NSPC imitates the structure of neural synaptic plasticity from a circuit wires connection perspective. Furthermore, from the principle of NSPC, we use a data mapping method to convert the convolution operations to matrix multiplications. Based on the methodology of NSPC, fully-pipelined and low latency architecture is designed. The proposed NSPC accelerator exhibits high hardware efficiency while maintaining a comparable network accuracy level. The NSPC based DCNN accelerator (NSPC-CNN) processes DCNN at $1.5625M$ images/ $s$ with a power dissipation of $15.42~W$ and an area of $36.4~mm^{2}$ . The NSPC based deep neural network (DNN) accelerator (NSPC-DNN) that implements three fully connected layers DNN consumes only $6.6~mm^{2}$ area and $2.93~W$ power, and achieves a throughput of $400M$ -images/ $s$ . Compared with conventional fixed-point implementations, the NSPC-CNN achieves $2.77 times $ area efficiency, $2.25 times $ power efficiency; the proposed NSPC-DNN exhibits $2.31 times $ area efficiency and $2.09 times $ power efficiency.

A Sliding-Kernel Computation-In-Memory Architecture for Convolutional Neural Network

DaDianNao: A Machine-Learning Supercomputer

In-Memory Computing Integrated Structure Circuit Based on Nonvolatile Flash Memory Unit

A Brain-Inspired In-Memory Computing System for Neuronal Communication Via Memristive Circuits.

A Skyrmion Racetrack Memory Based Computing In-memory Architecture for Binary Neural Convolutional Network

A Brain-Inspired Hierarchical Interactive In-Memory Computing System and Its Application in Video Sentiment Analysis

CMOS-compatible compute-in-memory accelerators based on integrated ferroelectric synaptic arrays for convolution neural networks

A Configurable Computing-in-Memory Structure Based on Convolutional Neural Network

Spatial-Temporal Hybrid Neural Network With Computing-in-Memory Architecture

A Systolic Computing-in-Memory Array Based Accelerator with Predictive Early Activation for Spatiotemporal Convolutions

A Multiply-Less Approximate SRAM Compute-In-Memory Macro for Neural-Network Inference

CIMulator: A Comprehensive Simulation Platform for Computing-In-Memory Circuit Macros with Low Bit-Width and Real Memory Materials

IMPACT:InMemory ComPuting Architecture Based on Y-FlAsh Technology for Coalesced Tsetlin Machine Inference

An Edram Based Computing-in-Memory Macro with Full-Valid-Storage and Channel-Wise-Parallelism for Depthwise Neural Network

An in-memory computing architecture based on two-dimensional semiconductors for multiply-accumulate operations

Memristor-based Deep Spiking Neural Network with a Computing-In-Memory Architecture

A Hybrid Computing-In-Memory Architecture by Monolithic 3D Integration of BEOL CNT/IGZO-based CFET Logic and Analog RRAM

An efficient full-size convolutional computing method based on memristor crossbar

A ReRAM-Based Computing-in-Memory Convolutional-Macro with Customized 2T2R Bit-Cell for AIoT Chip IP Applications

Neural Synaptic Plasticity-Inspired Computing: A High Computing Efficient Deep Convolutional Neural Network Accelerator

XNORAM: an Efficient Computing-in-Memory Architecture for Binary Convolutional Neural Networks with Flexible Dataflow Mapping.