Abstract:Machine learning has been widely applied in various emerging data-intensive applications, and has to be optimized and accelerated by powerful engines to process very large scale data. Recently, the instruction set based accelerators on Field Progarmmable Gate Arrays (FPGAs) have been a promising topic for machine learning applications. The customized instructions can be further scheduled to achieve higher instruction-level parallelism. In this article, we design a ubiquitous accelerator with out-of-order automatic parallelization for large-scale data-intensive applications. The accelerator accommodates four representative applications, including clustering algorithms, deep neural networks, genome sequencing, and collaborative filtering. In order to improve the coarse-grained instruction-level parallelism, the accelerator employs an out-of-order scheduling method to enable parallel dataflow computation. We use Colored Petri Net (CPN) tools to analyze the dependences in the applications, and build a hardware prototype on the real FPGA platform. For cluster applications, the accelerator can support four different algorithms, including K-Means, SLINK, PAM, and DBSCAN. For collaborative filtering applications, it accommodates Tanimoto, euclidean, Cosine, and Pearson Correlation as Similarity metrics. For deep learning applications, we implement hardware accelerators for both training process and inference process. Finally, for genome sequencing, we design a hardware accelerator for the BWA-SW algorithm. Experimental results show that the accelerator architecture can reach up to 25X speedup against Intel processors with affordable hardware cost, insignificant power consumption, and high flexibility.

BiS-KM: Enabling Any-Precision K-Means on FPGAs

SAKMA: Specialized FPGA-Based Accelerator Architecture for Data-Intensive K-Means Algorithms

KPynq: A Work-Efficient Triangle-Inequality Based K-means on FPGA

High-performance K-means Implementation based on a Simplified Map-Reduce Architecture

FPGA implementation of hardware processing modules as coprocessors in brain-machine interfaces.

TiAcc: Triangle-inequality Based Hardware Accelerator for K-means on FPGAs

A Ubiquitous Machine Learning Accelerator With Automatic Parallelization on FPGA

Ultra-Low-Latency and Flexible In-memory Key-Value Store System Design on CPU-FPGA

Optimizing Bit-Serial Matrix Multiplication for Reconfigurable Computing

Computing $k$-means in mixed precision

Evaluation of the effects of K-Means Clustered-Based Weight Quantization on a Keras Library Based Convolutional Neural Network for Hand Written Digit Image Recognition

An FPGA Based Accelerator for Clustering Algorithms With Custom Instructions

FPGA-Based Near-Memory Acceleration of Modern Data-Intensive Applications

SCADIS: A Scalable Accelerator for Data-Intensive String Set Matching on FPGAs

AxBMs: Approximate Radix-8 Booth Multipliers for High-Performance FPGA-Based Accelerators

Accelerating Graph Analytics by Co-Optimizing Storage and Access on an FPGA-HMC Platform

Low Precision Floating Point Arithmetic for High Performance FPGA-based CNN Acceleration

FINN-L: Library Extensions and Design Trade-off Analysis for Variable Precision LSTM Networks on FPGAs

L-FNNG: Accelerating Large-Scale KNN Graph Construction on CPU-FPGA Heterogeneous Platform

High-Level Synthesis of Online K-Means Clustering Hardware for a Real-Time Image Processing Pipeline