Abstract:Machine learning has been widely applied in various emerging data-intensive applications, and has to be optimized and accelerated by powerful engines to process very large scale data. Recently, the instruction set based accelerators on Field Progarmmable Gate Arrays (FPGAs) have been a promising topic for machine learning applications. The customized instructions can be further scheduled to achieve higher instruction-level parallelism. In this article, we design a ubiquitous accelerator with out-of-order automatic parallelization for large-scale data-intensive applications. The accelerator accommodates four representative applications, including clustering algorithms, deep neural networks, genome sequencing, and collaborative filtering. In order to improve the coarse-grained instruction-level parallelism, the accelerator employs an out-of-order scheduling method to enable parallel dataflow computation. We use Colored Petri Net (CPN) tools to analyze the dependences in the applications, and build a hardware prototype on the real FPGA platform. For cluster applications, the accelerator can support four different algorithms, including K-Means, SLINK, PAM, and DBSCAN. For collaborative filtering applications, it accommodates Tanimoto, euclidean, Cosine, and Pearson Correlation as Similarity metrics. For deep learning applications, we implement hardware accelerators for both training process and inference process. Finally, for genome sequencing, we design a hardware accelerator for the BWA-SW algorithm. Experimental results show that the accelerator architecture can reach up to 25X speedup against Intel processors with affordable hardware cost, insignificant power consumption, and high flexibility.

Accelerating Video-Mining Applications Using Many Small, General-Purpose Cores

DaDianNao: A Machine-Learning Supercomputer

Multi-channel Video-Based Parallel Fire Detection Acceleration Method Using Multi-Cores

Novel many-core architecture design for real-time image processing

Automated home video editing: a multi-core solution.

Survey of Parallel Acceleration Algorithms of Video Coding on Multi-core Processor

Parallelization and performance optimization of video feature extractions on multi-core systems*

A Multi-Core Parallel Fusion Algorithm for Remote-Sensing Image

Novel Multicore Video Processing Architecture

Warehouse-scale video acceleration: co-design and deployment in the wild

Parallelization and Performance Analysis of Video Feature Extractions on Multi-Core Based Systems

A Small-Footprint Accelerator for Large-Scale Neural Networks

A Ubiquitous Machine Learning Accelerator With Automatic Parallelization on FPGA

Heterogeneous Multi-core Systems for Video Processing

Optimizing a Parallel Video Encoder with Message Passing and a Shared Memory Architecture

Highly Parallel Line-Based Image Coding for Many Cores

Quartet: A 22nm 0.09mj/lnference Digital Compute-in-Memory Versatile AI Accelerator with Heterogeneous Tensor Engines and Off-Chip-Less Dataflow

A Manycore Vision Processor for Real-Time Smart Cameras

Large-scale Image Similarity Search Optimization Based on Multi-Core Architecture.

Huicore: A Generalized Hardware Accelerator for Complicated Functions

H.264 Video Parallel Decoder on A 24-Core Processor