Abstract:Deep learning is the amazing technology which has promoted the development of artificial intelligence and achieved many amazing successes in intelligent fields. Convolution-based layers (CLs), fully connected layers (FLs) and recurrent layers (RLs) are three types of layers in classic neural networks. Most intelligent tasks are implemented by the hybrid neural networks (hybrid-NNs), which are commonly composed of different layer-blocks (LBs) of CLs, FLs, and RLs. Because the CLs require the most computation in hybrid-NNs, many field-programmable gate array (FPGA)-based accelerators focus on CLs acceleration and have demonstrated great performance. However, the CLs accelerators lead to an underutilization of FPGA resources in the acceleration of the whole hybrid-NN. To fully exploit the logic resources and the memory bandwidth in the acceleration of CLs/FLs/RLs, we propose an FPGA resource efficient mapping mechanism for hybrid-NNs. The mechanism first improves the utilization of DSPs by integrating multiple small bit-width operations on one DSP. Then the LB-level spatial mapping is used to exploit the complementary features between different neural networks in the hybrid-NN. We evaluate the mapping mechanism by implementing four hybrid-NNs on Xilinx Virtex7 690T FPGA. The proposed mechanism achieves a peak performance of 1805.8 giga operations per second (GOPs). With the analysis on resource utilization and throughput, the proposed method exploits more computing power in FPGA and achieves up to <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$4.13 \times$ </tex-math></inline-formula> higher throughput than the state-of-the-art acceleration.

A Scalable Hybrid Architecture for High Performance Data-Parallel Applications

A Ubiquitous Machine Learning Accelerator With Automatic Parallelization on FPGA

A hybrid ARM‐FPGA cluster for cryptographic algorithm acceleration

Hardware Implementation on FPGA for Task-Level Parallel Dataflow Execution Engine.

A high throughput acceleration for hybrid neural networks with efficient resource management on FPGA

A Hybrid Approach to Cache Management in Heterogeneous CPU-FPGA Platforms.

Coarse-Grain Performance Estimator for Heterogeneous Parallel Computing Architectures like Zynq All-Programmable SoC

A Novel Scalable MPSoC Architecture Based on FPGA

FPGA Implementation of a Scheduler Supporting Parallel Dataflow Execution

Research on Parallel Architecture of OpenCL-Based FPGA.

Parallelizing Workload Execution in Embedded and High-Performance Heterogeneous Systems

Hybrid CNN-SVM Inference Accelerator on FPGA Using HLS

A Scalable Multi-FPGA Platform for Hybrid Intelligent Optimization Algorithms

HybridDNN: A Framework for High-Performance Hybrid DNN Accelerator Design and Implementation.

Analyzing Parallelization and Program Performance in Heterogeneous MPSoCs

Effective Runtime Scheduling for High-Performance Graph Processing on Heterogeneous Dataflow Architecture

Designing Hardware/Software Systems for Embedded High-Performance Computing

A Hardware And Software Task-Scheduling Framework Based On Cpu Plus Fpga Heterogeneous Architecture In Edge Computing

A Hybrid Reconfigurable Architecture and Design Methods Aiming at Control-Intensive Kernels

A Highly Customizable and Efficient Hardware Implementation for Parallel Matrix Inversion

Hardware Thread Accelerating Method Based on CPU/FPGA Hybrid Architecture