Abstract:Customized hardware accelerators have been developed to provide improved performance and efficiency for DNN inference and training. However, the existing hardware accelerators may not always be suitable for handling various DNN models as their architecture paradigms and configuration tradeoffs are highly application-specific. It is important to benchmark the accelerator candidates in the earliest stage to gather comprehensive performance metrics and locate the potential bottlenecks. Further demands also emerge after benchmarking, which require adequate solutions to address the bottlenecks and improve the current designs for targeted workloads. To achieve these goals, in this paper, we leverage an automation tool called DNNExplorer for benchmarking customized DNN hardware accelerators and exploring novel accelerator designs with improved performance and efficiency. Key features include (1) direct support to popular machine learning frameworks for DNN workload analysis and accurate analytical models for fast accelerator benchmarking; (2) a novel accelerator design paradigm with high-dimensional design space support and fine-grained adjustability to overcome the existing design drawbacks; and (3) a design space exploration (DSE) engine to generate optimized accelerators by considering targeted AI workloads and available hardware resources. Results show that accelerators adopting the proposed novel paradigm can deliver up to 4.2X higher throughput (GOP/s) than the state-of-the-art pipeline design in DNNBuilder and up to 2.0X improved efficiency than the recently published generic design in HybridDNN given the same DNN model and resource budgets. With DNNExplorer's benchmarking and exploration features, we can be ahead at building and optimizing customized AI accelerators and enable more efficient AI applications.

Improving Efficiency in Neural Network Accelerator Using Operands Hamming Distance Optimization

A Convolutional Neural Network Accelerator Architecture with Fine-Granular Mixed Precision Configurability.

Woodpecker-DL: Accelerating Deep Neural Networks via Hardware-Aware Multifaceted Optimizations

Efficient Hardware Optimization Strategies For Deep Neural Networks Acceleration Chip

Algorithm-Hardware Co-Optimization for Cost-Efficient ML-based ISP Accelerator

Exploring Resource-Aware Deep Neural Network Accelerator and Architecture Design

Design of a Convolutional Neural Network Accelerator Based on On-Chip Data Reordering

Optimizing Off-Chip Memory Access for Deep Neural Network Accelerator

A Construction Kit for Efficient Low Power Neural Network Accelerator Designs

A Low-Power Sparse Convolutional Neural Network Accelerator with Pre-Encoding Radix-4 Booth Multiplier

Tetris: Re-architecting Convolutional Neural Network Computation for Machine Learning Accelerators

A neural network accelerator for mobile application processors

An Energy-Efficient Near-Data Processing Accelerator for DNNs that Optimizes Data Accesses

A Survey on the Optimization of Neural Network Accelerators for Micro-AI On-Device Inference

An Efficient Sparse-Aware Summation Optimization Strategy for DNN Accelerator

Being-ahead: Benchmarking and Exploring Accelerators for Hardware-Efficient AI Deployment

A Heterogeneous Full-stack AI Platform for Performance Monitoring and Hardware-specific Optimizations

An Efficient General-Purpose Optical Accelerator for Neural Networks

Hardware Accelerated Optimization of Deep Learning Model on Artificial Intelligence Chip

SPARK: Scalable and Precision-Aware Acceleration of Neural Networks Via Efficient Encoding

A Data-Driven Asynchronous Neural Network Accelerator