Abstract:Recently, algorithm-hardware co-exploration for neural networks (NNs) has become the key to obtaining high-quality solutions. However, previous efforts for FPGAs focus on neural architecture search (NAS) while lacking hardware architecture search (HAS), thus limiting the full potential of co-design. Although expanding the scope of HAS offers performance potential, the exponentially increased joint search space presents a formidable challenge. To address this, we propose a deep and efficient framework, which jointly searches for Networks and Accelerators for FPGAs in a balanced co-search space. First, we adjust the NAS space and then introduce a block-level bitwidth search on the software side. Meanwhile, we design a hardware-friendly quantization algorithm to facilitate hardware efficiency and accuracy. Second, we design a dataflow-configurable hardware unit with computation and memory access optimizations for quantized multiplication. Based on this, we incorporate critical heterogeneous multicore architecture exploration on the hardware side. Third, to enable rapid hardware feedback in the enlarged HAS space, we perform resource and performance modeling and design a fast hardware generation algorithm based on the genetic algorithm. Specifically, we apply optimization techniques, like mapping space pruning, greedy bandwidth allocation, and coarse-grained search, to speed up this process. We validate in edge and cloud scenarios. Experimental results show that efficiently explores a significantly larger joint space and provides high-quality solutions. Compared with previous state-of-the-art co-design works, the searched CNN-accelerator pairs improve the throughput by 2.07× ~ 7.10× and energy efficiency by 1.41× ~ 2.27× under similar accuracy on the ImageNet dataset.

FPGA-based Accelerator Design for RankBoost in Web Search Engines

FPGA Acceleration of RankBoost in Web Search Engines

FPGA-based Accelerators for "Learning to Rank" in Web Search Engines

An FPGA-based Accelerator for LambdaRank in Web Search Engines

Distributed RankBoost Acceleration Using FPGA and MPI for Web Relevance Ranking

Lambdarank Acceleration For Relevance Ranking In Web Search Engines

FlexSaaS

Efficient Query Processing for Web Search Engine with FPGAs

Fpmr: Map Reduce Framework on Fpga A Case Study of Rankboost Acceleration

A Ubiquitous Machine Learning Accelerator With Automatic Parallelization on FPGA

An Efficient Lossless Compression Method for Internet Search Data in Hardware Accelerators

Co-design Hardware and Algorithm for Vector Search

Optimizing FPGA-based Accelerator Design for Large-Scale Molecular Similarity Search

Optimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks

Unleashing Network/Accelerator Co-Exploration Potential on FPGAs: A Deeper Joint Search

WooKong: A Ubiquitous Accelerator for Recommendation Algorithms with Custom Instruction Sets on FPGA

RankBoost Acceleration on both NVIDIA CUDA and ATI Stream Platforms

[DL] A Survey of FPGA-based Neural Network Inference Accelerators

A Survey of FPGA-Based Neural Network Accelerator

Efficient FPGA-Based Accelerator of the L-BFGS Algorithm for IoT Applications.

An FPGA-Based Accelerator for Neighborhood-Based Collaborative Filtering Recommendation Algorithms