Abstract:Machine learning has been widely applied in various emerging data-intensive applications, and has to be optimized and accelerated by powerful engines to process very large scale data. Recently, the instruction set based accelerators on Field Progarmmable Gate Arrays (FPGAs) have been a promising topic for machine learning applications. The customized instructions can be further scheduled to achieve higher instruction-level parallelism. In this article, we design a ubiquitous accelerator with out-of-order automatic parallelization for large-scale data-intensive applications. The accelerator accommodates four representative applications, including clustering algorithms, deep neural networks, genome sequencing, and collaborative filtering. In order to improve the coarse-grained instruction-level parallelism, the accelerator employs an out-of-order scheduling method to enable parallel dataflow computation. We use Colored Petri Net (CPN) tools to analyze the dependences in the applications, and build a hardware prototype on the real FPGA platform. For cluster applications, the accelerator can support four different algorithms, including K-Means, SLINK, PAM, and DBSCAN. For collaborative filtering applications, it accommodates Tanimoto, euclidean, Cosine, and Pearson Correlation as Similarity metrics. For deep learning applications, we implement hardware accelerators for both training process and inference process. Finally, for genome sequencing, we design a hardware accelerator for the BWA-SW algorithm. Experimental results show that the accelerator architecture can reach up to 25X speedup against Intel processors with affordable hardware cost, insignificant power consumption, and high flexibility.

Implimentations of SIMD machine using programmable gate array

An alternative approach of the programmable arrays and applications

Design and implementation of a new FPGA architecture

Design and Implementation of High Speed Fixed-Point Fast Fourier Transform Processor

A Pipelined Loop Array Architecture

DMA-based High-Speed Parallel Acquisition System of Digital Signals

SIMDive: Approximate SIMD Soft Multiplier-Divider for FPGAs with Tunable Accuracy

A Ubiquitous Machine Learning Accelerator With Automatic Parallelization on FPGA

A reconfigurable pipelined array system

A Case for a Flexible Scalar Unit in SIMT Architecture

A Compute Environment of ABC95 Array Computer Based on Multi-FPGA Chip

A high performance FFT library with single instruction multiple data (SIMD) architecture

A Novel Reconfigurable Architecture of a DSP Processor for Efficient Mapping of DSP Functions using Field Programmable DSP Arrays

A FPGA Placement Algorithm Based on Parallel Simulated Annealing

An Efficient SIMD Parallel Memory Structure for Radix-2 FFT Computation

Implementation of Dynamic Matrix Control on Field Programmable Gate Array

Design and Implementation of High Performance Subword-Parallel Arithmetic Units

Single instruction multiple data code auto generation for a very long instruction words digital signal processor in sensor-based systems

FT-Matrix: A Coordination-Aware Architecture for Signal Processing

Field Programmable Gate Array Prototyping of End-Around Carry Parallel Prefix Tree Architectures

MIMD Programs Execution Support on SIMD Machines: A Holistic Survey