Abstract:High-level synthesis (HLS) of data-parallel input languages, such as the Compute Unified Device Architecture (CUDA), enables efficient description and implementation of independent computation cores. HLS tools can effectively translate the many threads of computation present in the parallel descriptions into independent, optimized cores. The generated hardware cores often heavily share input data and produce outputs independently. As the number of instantiated cores grows, the off-chip memory bandwidth may be insufficient to meet the demand. Hence, a scalable system architecture and a data-sharing mechanism become necessary for improving system performance. The network-on-chip (NoC) paradigm for intrachip communication has proved to be an efficient alternative to a hierarchical bus or crossbar interconnect, since it can reduce wire routing congestion, and has higher operating frequencies and better scalability for adding new nodes. In this paper, we present a customizable NoC architecture along with a directory-based data-sharing mechanism for an existing CUDA-to-FPGA (FCUDA) flow to enable scalability of our system and improve overall system performance. We build a fully automated FCUDA-NoC generator that takes in CUDA code and custom network parameters as inputs and produces synthesizable register transfer level (RTL) code for the entire NoC system. We implement the NoC system on a VC709 Xilinx evaluation board and evaluate our architecture with a set of benchmarks. The results demonstrate that our FCUDA-NoC design is scalable and efficient and we improve the system execution time by up to 63× and reduce external memory reads by up to 81% compared with a single hardware core implementation.

Evaluation and Design Space Exploration of a Time-Division Multiplexed NoC on FPGA for Image Analysis Applications

FPGA based cellular neural network optimization: from design space to system.

A Multi-Level-Optimization Framework for FPGA-Based Cellular Neural Network Implementation.

Building A Multi-Fpga-Based Emulation Framework To Support Networks-On-Chip Design And Verification

Fpga Prototype Design Of Network On Chips

Adaptive FPGA NoC-based Architecture for Multispectral Image Correlation

Novel many-core architecture design for real-time image processing

Design and FPGA Verification of a Novel Reliable Real-Time Data Transfer System

Design space exploration for image processing architectures on FPGA targets

Star-Wheels Network-on-Chip featuring a self-adaptive mixed topology and a synergy of a circuit - and a packet-switching communication protocol

A Novel Reconfigurable Computing Architecture for Image Signal Processing Using Circuit-Switched NoC and Synchronous Dataflow Model.

FCUDA-NoC: A Scalable and Efficient Network-on-Chip Implementation for the CUDA-to-FPGA Flow

A Reconfigurable 2D-Mesh NoC Design with Agile Development Technique of SpinalHDL

Design of 3D NoC Network Architecture

Low-latency Deterministic Forwarding for Multi-modal Connection Using Time-Sensitive Networking.

Statistical time division multiplexing based local system architecture for multi-cluster NoC

Performance Evaluation of Application Mapping Approaches for Network-on-Chip Designs

A Low-Cost and High-Throughput NoC-Aware Chip-to-Chip Interconnection

Design and Simulation of Ring Network-on-Chip for Different Configured Nodes

Scalable Light-Weight Integration of FPGA Based Accelerators with Chip Multi-Processors

A fast multi-core virtual platform for performance evaluation of Network on Chip