Abstract:Existing FPGA-based DNN accelerators typically fall into two design paradigms. Either they adopt a generic reusable architecture to support different DNN networks but leave some performance and efficiency on the table because of the sacrifice of design specificity. Or they apply a layer-wise tailor-made architecture to optimize layer-specific demands for computation and resources but loose the scalability of adaptation to a wide range of DNN networks. To overcome these drawbacks, this paper proposes a novel FPGA-based DNN accelerator design paradigm and its automation tool, called DNNExplorer, to enable fast exploration of various accelerator designs under the proposed paradigm and deliver optimized accelerator architectures for existing and emerging DNN networks. Three key techniques are essential for DNNExplorer's improved performance, better specificity, and scalability, including (1) a unique accelerator design paradigm with both high-dimensional design space support and fine-grained adjustability, (2) a dynamic design space to accommodate different combinations of DNN workloads and targeted FPGAs, and (3) a design space exploration (DSE) engine to generate optimized accelerator architectures following the proposed paradigm by simultaneously considering both FPGAs' computation and memory resources and DNN networks' layer-wise characteristics and overall complexity. Experimental results show that, for the same FPGAs, accelerators generated by DNNExplorer can deliver up to 4.2x higher performances (GOP/s) than the state-of-the-art layer-wise pipelined solutions generated by DNNBuilder for VGG-like DNN with 38 CONV layers. Compared to accelerators with generic reusable computation units, DNNExplorer achieves up to 2.0x and 4.4x DSP efficiency improvement than a recently published accelerator design from academia (HybridDNN) and a commercial DNN accelerator IP (Xilinx DPU), respectively.

TRIM: A Design Space Exploration Model for Deep Neural Networks Inference and Training Accelerators

A Near Memory Computing FPGA Architecture for Neural Network Acceleration

High-performance Reconfigurable DNN Accelerator on a Bandwidth-limited Embedded System

Software-defined Design Space Exploration for an Efficient DNN Accelerator Architecture

DNNExplorer: A Framework for Modeling and Exploring a Novel Paradigm of FPGA-based DNN Accelerator

TrIMS: Transparent and Isolated Model Sharing for Low Latency Deep LearningInference in Function as a Service Environments

A fine-grained mixed precision DNN accelerator using a two-stage big-little core RISC-V MCU.

Being-ahead: Benchmarking and Exploring Accelerators for Hardware-Efficient AI Deployment

NNest: Early-Stage Design Space Exploration Tool for Neural Network Inference Accelerators

TrIM: Triangular Input Movement Systolic Array for Convolutional Neural Networks -- Part II: Architecture and Hardware Implementation

A Heterogeneous Full-stack AI Platform for Performance Monitoring and Hardware-specific Optimizations

Invited: Algorithm-Software-Hardware Co-Design for Deep Learning Acceleration

A Highly Configurable Hardware/Software Stack for DNN Inference Acceleration

INDM: Chiplet-Based Interconnect Network and Dataflow Mapping for DNN Accelerators

Processing-in-Memory Accelerator for Dynamic Neural Network with Run-Time Tuning of Accuracy, Power and Latency

Automatic Generation of Fast and Accurate Performance Models for Deep Neural Network Accelerators

Spatio-Temporal Optimization of Deep Neural Networks for Reconfigurable FPGA SoCs

Procrustes: a Dataflow and Accelerator for Sparse Deep Neural Network Training

Deep Neural Network Hardware Deployment Optimization via Advanced Active Learning

A DNN Optimization Framework with Unlabeled Data for Efficient and Accurate Reconfigurable Hardware Inference

Research on Convolutional Neural Network Inference Acceleration and Performance Optimization for Edge Intelligence