Abstract:Deep neural networks (DNNs) have the advantage that they can take into account a large number of parameters, which enables them to solve complex tasks. In computer vision and speech recognition, they have a better accuracy than common algorithms, and in some tasks, they boast an even higher accuracy than human experts. With the progress of DNNs in recent years, many other fields of application such as diagnosis of diseases and autonomous driving are taking advantage of them. The trend at DNNs is clear: The network size is growing exponentially, which leads to an exponential increase in computational effort and required memory size. For this reason, optimized hardware accelerators are used to increase the performance of the inference of neuronal networks. However, there are various neural network hardware accelerator platforms, such as graphics processing units (GPUs), application specific integrated circuits (ASICs) and field programmable gate arrays (FPGAs). Each of these platforms offer certain advantages and disadvantages. Also, there are various methods for reducing the computational effort of DNNs, which are differently suitable for each hardware accelerator. In this article an overview of existing neural network hardware accelerators and acceleration methods is given. Their strengths and weaknesses are shown and a recommendation of suitable applications is given. In particular, we focus on acceleration of the inference of convolutional neural networks (CNNs) used for image recognition tasks. Given that there exist many different hardware architectures. FPGA-based implementations are well-suited to show the effect of DNN optimization methods on accuracy and throughput. For this reason, the focus of this work is more on FPGA-based implementations.

A Weight-Adjustable Hardware Accelerator Board for Dtcnn Implementation and Application

A Near Memory Computing FPGA Architecture for Neural Network Acceleration

High-performance Reconfigurable DNN Accelerator on a Bandwidth-limited Embedded System

DaDianNao: A Machine-Learning Supercomputer

Adaptive design and implementation of automatic modulation recognition accelerator

A fine-grained mixed precision DNN accelerator using a two-stage big-little core RISC-V MCU.

Work-in-Progress: BloCirNN: an Efficient Software/hardware Codesign Approach for Neural Network Accelerators with Block-Circulant Matrix

A FPGA-based Hardware Accelerator for Bayesian Confidence Propagation Neural Network

A Fast Spiking Neural Network Accelerator based on BP-STDP Algorithm and Weighted Neuron Model

A Low-Latency DNN Accelerator Enabled by DFT-Based Convolution Execution Within Crossbar Arrays

A High-Efficiency FPGA-Based Accelerator for Binarized Neural Network

A high-speed reusable quantized hardware accelerator design for CNN on constrained edge device

Learning on Hardware: A Tutorial on Neural Network Accelerators and Co-Processors

Improving the accuracy of neural networks in analog computing-in-memory systems by analog weight.

Recent Advances in Efficient Computation of Deep Convolutional Neural Networks

FPGA Based Implementation of Deep Neural Networks Using On-chip Memory Only

HAO: Hardware-aware neural Architecture Optimization for Efficient Inference

Invited: Algorithm-Software-Hardware Co-Design for Deep Learning Acceleration

A 16 nJ/Classification FPGA-Based Wired-Logic DNN Accelerator Using Fixed-Weight Non-Linear Neural Net

Embedded Streaming Deep Neural Networks Accelerator With Applications