Abstract:Today, convolutional anddeconvolutional neural network models are exceptionally popular thanks to the impressive accuracies they have been proven in several computer-vision applications. To speed up the overall tasks of these neural networks, purpose-designed accelerators are highly desirable. Unfortunately, the high computational complexity and the huge memory demand make the design of efficient hardware architectures, as well as their deployment in resource- and power-constrained embedded systems, still quite challenging. This paper presents a novel purpose-designed hardware accelerator to perform 2D deconvolutions. The proposed structure applies a hardware-oriented computational approach that overcomes the issues of traditional deconvolution methods, and it is suitable for being implemented within any virtually system-on-chip based on field-programmable gate array devices. In fact, the novel accelerator is simply scalable to comply with resources available within both high- and low-end devices by adequately scaling the adopted parallelism. As an example, when exploited to accelerate the Deep Convolutional Generative Adversarial Network model, the novel accelerator, running as a standalone unit implemented within the Xilinx Zynq XC7Z020 System-on-Chip (SoC) device, performs up to 72 GOPs. Moreover, it dissipates less than 500mW@200MHz and occupies 5.6%, 4.1%, 17%, and 96%, respectively, of the look-up tables, flip-flops, random access memory, and digital signal processors available on-chip. When accommodated within the same device, the whole embedded system equipped with the novel accelerator performs up to 54 GOPs and dissipates less than 1.8W@150MHz. Thanks to the increased parallelism exploitable, more than 900 GOPs can be executed when the high-end Virtex-7 XC7VX690T device is used as the implementation platform. Moreover, in comparison with state-of-the-art competitors implemented within the Zynq XC7Z045 device, the system proposed here reaches a computational capability up to 20% higher, and saves more than 60% and 80% of power consumption and logic resources requirement, respectively, using 5.7× fewer on-chip memory resources.

HDSuper: High-Quality and High Computational Utilization Edge Super-Resolution Accelerator With Hardware-Algorithm Co-Design Techniques

A High-Performance Accelerator for Real-Time Super-Resolution on Edge FPGAs

ESSR: An 8K@30FPS Super-Resolution Accelerator With Edge Selective Network

A Convolutional Neural Network Accelerator Architecture with Fine-Granular Mixed Precision Configurability.

A 28-nm Computing-in-Memory-Based Super-Resolution Accelerator Incorporating Macro-Level Pipeline and Texture/Algebraic Sparsity

ACNPU: A 4.75TOPS/W 1080P@30FPS Super Resolution Accelerator with Decoupled Asymmetric Convolution

Single Image Super-Resolution Via the Implementation of the Hardware-Friendly Sparse Coding

CNN Acceleration With Hardware-Efficient Dataflow for Super-Resolution

Efficient Super-Resolution System with Block-Wise Hybridization and Quantized Winograd on FPGA

FPGA Implementation of Feature Detection Algorithm Based on High Level Synthesis

Efficient FPGA Binary Neural Network Architecture for Image Super-Resolution

UArch: A Super-Resolution Processor with Heterogeneous Triple-Core Architecture for Workloads of U-Net Networks

A High-Performance FPGA-Based Depthwise Separable Convolution Accelerator

Hundred-Kilobyte Lookup Tables for Efficient Single-Image Super-Resolution

A Weight-Reload-Eliminated Compute-in-Memory Accelerator for 60 fps 4K Super-Resolution

Efficient Deconvolution Architecture for Heterogeneous Systems-on-Chip

Hardware Implementation of Depthwise Separable Convolution Neural Network

FPGA-Based Real-Time Super-Resolution System for Ultra High Definition Videos

HISP: Heterogeneous Image Signal Processor Pipeline Combining Traditional and Deep Learning Algorithms Implemented on FPGA

An FPGA-Based Residual Recurrent Neural Network for Real-Time Video Super-Resolution

A High-Performance Accelerator for Super-Resolution Processing on Embedded GPU