Abstract:Today, convolutional anddeconvolutional neural network models are exceptionally popular thanks to the impressive accuracies they have been proven in several computer-vision applications. To speed up the overall tasks of these neural networks, purpose-designed accelerators are highly desirable. Unfortunately, the high computational complexity and the huge memory demand make the design of efficient hardware architectures, as well as their deployment in resource- and power-constrained embedded systems, still quite challenging. This paper presents a novel purpose-designed hardware accelerator to perform 2D deconvolutions. The proposed structure applies a hardware-oriented computational approach that overcomes the issues of traditional deconvolution methods, and it is suitable for being implemented within any virtually system-on-chip based on field-programmable gate array devices. In fact, the novel accelerator is simply scalable to comply with resources available within both high- and low-end devices by adequately scaling the adopted parallelism. As an example, when exploited to accelerate the Deep Convolutional Generative Adversarial Network model, the novel accelerator, running as a standalone unit implemented within the Xilinx Zynq XC7Z020 System-on-Chip (SoC) device, performs up to 72 GOPs. Moreover, it dissipates less than 500mW@200MHz and occupies 5.6%, 4.1%, 17%, and 96%, respectively, of the look-up tables, flip-flops, random access memory, and digital signal processors available on-chip. When accommodated within the same device, the whole embedded system equipped with the novel accelerator performs up to 54 GOPs and dissipates less than 1.8W@150MHz. Thanks to the increased parallelism exploitable, more than 900 GOPs can be executed when the high-end Virtex-7 XC7VX690T device is used as the implementation platform. Moreover, in comparison with state-of-the-art competitors implemented within the Zynq XC7Z045 device, the system proposed here reaches a computational capability up to 20% higher, and saves more than 60% and 80% of power consumption and logic resources requirement, respectively, using 5.7× fewer on-chip memory resources.

High performance dilated convolutions on multi-core DSPs

An Efficient Hardware Implementation of Dilated Convolution Using a Novel Channel-Equivalent Decomposition Method.

High-performance Reconfigurable DNN Accelerator on a Bandwidth-limited Embedded System

A fine-grained mixed precision DNN accelerator using a two-stage big-little core RISC-V MCU.

Accelerate Convolutional Neural Network With A Customized Vliw Dsp

Performance Analysis of DNN Inference/Training with Convolution and non-Convolution Operations

Efficient Deconvolution Architecture for Heterogeneous Systems-on-Chip

GPNPU: Enabling Efficient Hardware-Based Direct Convolution with Multi-Precision Support in GPU Tensor Cores

Efficient Processing of Convolutional Neural Networks on SW26010.

A Flexible and Efficient FPGA Accelerator for Various Large-Scale and Lightweight CNNs

An Efficient Accelerator for Multiple Convolutions From the Sparsity Perspective

High performance parallel processing system based on dual port memories

HybridDNN: A Framework for High-Performance Hybrid DNN Accelerator Design and Implementation.

A High-Performance FPGA-Based Depthwise Separable Convolution Accelerator

High‐Throughput Multichannel Parallelized Diffraction Convolutional Neural Network Accelerator

An Effective Design to Improve the Efficiency of DPUs on FPGA

LUT‐DSP usage trade‐off for re‐configurable convolution acceleration core based on small logarithmic floating point representation

Dsp-Based Parallel Implementation Of Speeded-Up Robust Features

Accelerating DNN Inference with Heterogeneous Multi-DPU Engines

MG3MConv: Multi-Grained Matrix-Multiplication-Mapping Convolution Algorithm toward the SW26010 Processor

Accelerating Convolutional Processing by Harnessing Channel Shifts in Arrayed Waveguide Gratings