Abstract:Customized hardware accelerators have been developed to provide improved performance and efficiency for DNN inference and training. However, the existing hardware accelerators may not always be suitable for handling various DNN models as their architecture paradigms and configuration tradeoffs are highly application-specific. It is important to benchmark the accelerator candidates in the earliest stage to gather comprehensive performance metrics and locate the potential bottlenecks. Further demands also emerge after benchmarking, which require adequate solutions to address the bottlenecks and improve the current designs for targeted workloads. To achieve these goals, in this paper, we leverage an automation tool called DNNExplorer for benchmarking customized DNN hardware accelerators and exploring novel accelerator designs with improved performance and efficiency. Key features include (1) direct support to popular machine learning frameworks for DNN workload analysis and accurate analytical models for fast accelerator benchmarking; (2) a novel accelerator design paradigm with high-dimensional design space support and fine-grained adjustability to overcome the existing design drawbacks; and (3) a design space exploration (DSE) engine to generate optimized accelerators by considering targeted AI workloads and available hardware resources. Results show that accelerators adopting the proposed novel paradigm can deliver up to 4.2X higher throughput (GOP/s) than the state-of-the-art pipeline design in DNNBuilder and up to 2.0X improved efficiency than the recently published generic design in HybridDNN given the same DNN model and resource budgets. With DNNExplorer's benchmarking and exploration features, we can be ahead at building and optimizing customized AI accelerators and enable more efficient AI applications.

Accuracy Measurement of Deep Neural Network Accelerator Via Metamorphic Testing.

DaDianNao: A Machine-Learning Supercomputer

Automatic Generation of Fast and Accurate Performance Models for Deep Neural Network Accelerators

A fine-grained mixed precision DNN accelerator using a two-stage big-little core RISC-V MCU.

DNN+NeuroSim V2.0: An End-to-End Benchmarking Framework for Compute-in-Memory Accelerators for On-chip Training

Machine Learning-enabled Performance Model for DNN Applications and AI Accelerator

A Data-Driven Asynchronous Neural Network Accelerator

On the Accuracy of Analog Neural Network Inference Accelerators

Being-ahead: Benchmarking and Exploring Accelerators for Hardware-Efficient AI Deployment

Computing-In-Memory Neural Network Accelerators for Safety-Critical Systems: Can Small Device Variations Be Disastrous?

A neural network accelerator for mobile application processors

An Algorithm-Hardware Co-design Framework to Overcome Imperfections of Mixed-signal DNN Accelerators

Benchmarking the Performance and Energy Efficiency of AI Accelerators for AI Training

DNN-Chip Predictor: An Analytical Performance Predictor for DNN Accelerators with Various Dataflows and Hardware Architectures

A Practical Implementation of GPU based Accelerator for Deep Neural Networks

NNASIM: an Efficient Event-Driven Simulator for DNN Accelerators with Accurate Timing and Area Models

A Heterogeneous Full-stack AI Platform for Performance Monitoring and Hardware-specific Optimizations

Software-defined Design Space Exploration for an Efficient DNN Accelerator Architecture

Evaluating Emerging AI/ML Accelerators: IPU, RDU, and NVIDIA/AMD GPUs

A Small-Footprint Accelerator for Large-Scale Neural Networks