Abstract:Deep learning (DL) is becoming the cornerstone of numerous applications both in datacenters and at the edge. Specialized hardware is often necessary to meet the performance requirements of state-of-the-art DL models, but the rapid pace of change in DL models and the wide variety of systems integrating DL make it impossible to create custom computer chips for all but the largest markets. Field-programmable gate arrays (FPGAs) present a unique blend of reprogrammability and direct hardware execution that make them suitable for accelerating DL inference. They offer the ability to customize processing pipelines and memory hierarchies to achieve lower latency and higher energy efficiency compared to general-purpose CPUs and GPUs, at a fraction of the development time and cost of custom chips. Their diverse high-speed IOs also enable directly interfacing the FPGA to the network and/or a variety of external sensors, making them suitable for both datacenter and edge use cases. As DL has become an ever more important workload, FPGA architectures are evolving to enable higher DL performance. In this article, we survey both academic and industrial FPGA architecture enhancements for DL. First, we give a brief introduction on the basics of FPGA architecture and how its components lead to strengths and weaknesses for DL applications. Next, we discuss different styles of DL inference accelerators on FPGA, ranging from model-specific dataflow styles to software-programmable overlay styles. We survey DL-specific enhancements to traditional FPGA building blocks such as logic blocks, arithmetic circuitry, and on-chip memories, as well as new in-fabric DL-specialized blocks for accelerating tensor computations. Finally, we discuss hybrid devices that combine processors and coarse-grained accelerator blocks with FPGA-like interconnect and networks-on-chip, and highlight promising future research directions.

Design and implementation of a new FPGA architecture

Design of Structured Light Depth Detection System Based on FPGA

Design And Implementation Of The Configuration Circuit For Fdp Fpga

Programmable Logic Device FDP100K for Data-Path Application

The Architecture of FDP FPGA Device

Circuit Design of A Novel Fpga Chip Fdp2008

Field-Programmable Gate Array Architecture for Deep Learning: Survey & Future Directions

FPGA Architecture: Principles and Progression

FDE2009 Software System for Programmable Logic Device with Hierarchical Architecture

Design and development of a computer interface experimental platform bawd on advanced FPGA

FPGA Based Big Data Accelerator Design in Teaching Computer Architecture and Organization.

Scalable and Low-power FPGA Programming/Downloading Full Custom Circuit Design

Development and Optimization Design of Digital Logic device based on FPGA

Implement of EDA Design Using FPGA & CPLD

Boundary-scan Test Circuit Designed for FPGA

Design and Implementation of a Delay-Optimized Universal Programmable Routing Circuit for FPGAs

Python FPGA Programming with Data-Centric Multi-Level Design

Direct Universal Access: Making Data Center Resources Available To Fpga

FPGA Power and Timing Optimization: Architecture, Process, and CAD

Field Programmable Gate Array Prototyping of End-Around Carry Parallel Prefix Tree Architectures

A New FPGA Architecture Suitable for DSP Applications