Abstract:Recent breakthroughs in Deep Neural Networks (DNNs) have fueled a growing demand for DNN chips. However, designing DNN chips is non-trivial because: (1) mainstream DNNs have millions of parameters and operations; (2) the large design space due to the numerous design choices of dataflows, processing elements, memory hierarchy, etc.; and (3) an algorithm/hardware co-design is needed to allow the same DNN functionality to have a different decomposition, which would require different hardware IPs to meet the application specifications. Therefore, DNN chips take a long time to design and require cross-disciplinary experts. To enable fast and effective DNN chip design, we propose AutoDNNchip - a DNN chip generator that can automatically generate both FPGA- and ASIC-based DNN chip implementation given DNNs from machine learning frameworks (e.g., PyTorch) for a designated application and dataset. Specifically, AutoDNNchip consists of two integrated enablers: (1) a Chip Predictor, built on top of a graph-based accelerator representation, which can accurately and efficiently predict a DNN accelerator's energy, throughput, and area based on the DNN model parameters, hardware configuration, technology-based IPs, and platform constraints; and (2) a Chip Builder, which can automatically explore the design space of DNN chips (including IP selection, block configuration, resource balancing, etc.), optimize chip design via the Chip Predictor, and then generate optimized synthesizable RTL to achieve the target design metrics. Experimental results show that our Chip Predictor's predicted performance differs from real-measured ones by < 10% when validated using 15 DNN models and 4 platforms (edge-FPGA/TPU/GPU and ASIC). Furthermore, accelerators generated by our AutoDNNchip can achieve better (up to 3.86X improvement) performance than that of expert-crafted state-of-the-art accelerators.

ASIC-based Gauss Error Function Module Design for Neural Network Application

ASIC Implementation of a Nonlinear Dynamical Model for Hippocampal Prosthesis

Design of a Hippocampal Cognitive Prosthesis Chip

FPGA based cellular neural network optimization: from design space to system.

ASIC Design of Nanoscale Artificial Neural Networks for Inference/Training by Floating-Point Arithmetic

A fine-grained mixed precision DNN accelerator using a two-stage big-little core RISC-V MCU.

Efficient Hardware Configuration Method for Photonic Neural Network with Genetic Algorithm

Design Space Exploration of Neural Network Activation Function Circuits

Co-design of a novel CMOS highly parallel, low-power, multi-chip neural network accelerator

Precise and low-power closed-loop neuromodulation through algorithm-integrated circuit co-design

A reconfigurable neural network ASIC for detector front-end data compression at the HL-LHC

Co-Exploration of Neural Architectures and Heterogeneous ASIC Accelerator Designs Targeting Multiple Tasks

NEUTRAMS: Neural Network Transformation and Co-Design under Neuromorphic Hardware Constraints

Rapid Configuration of Asynchronous Recurrent Neural Networks for ASIC Implementations

MAGNet: A Modular Accelerator Generator for Neural Networks

Automated and Holistic Co-design of Neural Networks and ASICs for Enabling In-Pixel Intelligence

AutoDNNchip: An Automated DNN Chip Predictor and Builder for Both FPGAs and ASICs

An FPGA-Based Neuron Activity Extraction Unit for a Wireless Neural Interface

Reconfigurable ASIC Implementation of Asynchronous Recurrent Neural Networks

An Energy-Efficient Neural Network Accelerator With Improved Resilience Against Fault Attacks

Design and Optimization of FeFET Based CiM for Neural Network Acceleration