Abstract:Machine learning has been widely applied in various emerging data-intensive applications, and has to be optimized and accelerated by powerful engines to process very large scale data. Recently, the instruction set based accelerators on Field Progarmmable Gate Arrays (FPGAs) have been a promising topic for machine learning applications. The customized instructions can be further scheduled to achieve higher instruction-level parallelism. In this article, we design a ubiquitous accelerator with out-of-order automatic parallelization for large-scale data-intensive applications. The accelerator accommodates four representative applications, including clustering algorithms, deep neural networks, genome sequencing, and collaborative filtering. In order to improve the coarse-grained instruction-level parallelism, the accelerator employs an out-of-order scheduling method to enable parallel dataflow computation. We use Colored Petri Net (CPN) tools to analyze the dependences in the applications, and build a hardware prototype on the real FPGA platform. For cluster applications, the accelerator can support four different algorithms, including K-Means, SLINK, PAM, and DBSCAN. For collaborative filtering applications, it accommodates Tanimoto, euclidean, Cosine, and Pearson Correlation as Similarity metrics. For deep learning applications, we implement hardware accelerators for both training process and inference process. Finally, for genome sequencing, we design a hardware accelerator for the BWA-SW algorithm. Experimental results show that the accelerator architecture can reach up to 25X speedup against Intel processors with affordable hardware cost, insignificant power consumption, and high flexibility.

Design of an Extended Floating-Point Multiply-Add-Fused Unit for Exploiting Instruction-Level Parallelism

A Low Latency High Throughput Multiply-accumulator Unit for Float Point and Integer

Optimized Design of a Double-Precision Floating-Point Multiply-Add-dused Unit for Data Dependence.

Design of A Double-Precision Floating- Point Multiply-Add-Fused Unit with Consideration of Data Dependence

Design of A Fully Pipelined Single-Precision Multiply-Add-Fused Unit

A Low-Cost Floating-Point FMA Unit Supporting Package Operations for HPC-AI Applications

CSA-CiM: Enhancing Multi-Functional Computing-in-Memory with Configurable Sense Amplifiers

An Effective Implementation of Dual Path Fused Floating-Point Add-Subtract Unit for Reconfigurable Architectures

Field Programmable Gate Array Prototyping of End-Around Carry Parallel Prefix Tree Architectures

Improving Ilp Via Fused In-Order Superscalar And Vliw Instruction Dispatch Methods

Design of A Fully Pipelined Single-Precision Floating-Point Unit

Multiply-add fused float point unit with on-fly denormalized number processing

A standard cell automated layout for a CMOS 50 MHz 8*8 bit pipelined parallel Dadda multiplier

A Fused Continuous Floating-Point Mac On Fpga

Online Alignment and Addition in Multi-Term Floating-Point Adders

Design of Field Programmable Gate Array Based Real-Time Double-Precision Floating-Point Matrix Multiplier

Floating-Point Unit Processing Denormalized Numbers

Instruction Fusion Technology for the MIPS

8×8 Bit Pipelined Dadda Multiplier in CMOS

A Ubiquitous Machine Learning Accelerator With Automatic Parallelization on FPGA

FHAM: FPGA-based High-Efficiency Approximate Multipliers Via LUT Encoding