Abstract:High-level synthesis (HLS) of data-parallel input languages, such as the Compute Unified Device Architecture (CUDA), enables efficient description and implementation of independent computation cores. HLS tools can effectively translate the many threads of computation present in the parallel descriptions into independent, optimized cores. The generated hardware cores often heavily share input data and produce outputs independently. As the number of instantiated cores grows, the off-chip memory bandwidth may be insufficient to meet the demand. Hence, a scalable system architecture and a data-sharing mechanism become necessary for improving system performance. The network-on-chip (NoC) paradigm for intrachip communication has proved to be an efficient alternative to a hierarchical bus or crossbar interconnect, since it can reduce wire routing congestion, and has higher operating frequencies and better scalability for adding new nodes. In this paper, we present a customizable NoC architecture along with a directory-based data-sharing mechanism for an existing CUDA-to-FPGA (FCUDA) flow to enable scalability of our system and improve overall system performance. We build a fully automated FCUDA-NoC generator that takes in CUDA code and custom network parameters as inputs and produces synthesizable register transfer level (RTL) code for the entire NoC system. We implement the NoC system on a VC709 Xilinx evaluation board and evaluate our architecture with a set of benchmarks. The results demonstrate that our FCUDA-NoC design is scalable and efficient and we improve the system execution time by up to 63× and reduce external memory reads by up to 81% compared with a single hardware core implementation.

Design of a Asynchronous Shared -FIFO for NoC

An Improved Asynchronous Wrapper for GALS

Design of Adiabatic FIFO Based on Clocked Transmission Gate Adiabatic Logic Circuit

A High-Performance Asynchronous FIFO Architecture

Low Latency High Throughout Circular Asynchronous FIFO

A 2d Mesh Noc With Self-Configurable And Shared-Fifos Routers

An Asynchronous FIFO Design Based on Weighted Gray Coding and Real-Time State Detection

An improved design of optical LIFO buffer with switched delay lines

Efficient Designs of Optical LIFO Buffer with Switches and Fiber Delay Lines

Constructing $N$-to-$n$ Shared Optical Queues with Switches and Fiber Delay Lines

FCUDA-NoC: A Scalable and Efficient Network-on-Chip Implementation for the CUDA-to-FPGA Flow

An adaptive buffer-shared routing algorithm for NoC designs

Fpga Prototype Design Of Network On Chips

A Hierarchical C2RTL Framework for FIFO-connected Stream Applications

A Scalable Dual-Clock FIFO for Data Transfers Between Arbitrary and Haltable Clock Domains.

Bram-Based Asynchronous Fifo in Fpga with Optimized Cycle Latency

A High-Throughput and Size-Efficient NoC Buffer Design Method

High Throughput Memory Data-Path Design For Multi-Core Architecture

A Low-Cost and High-Throughput NoC-Aware Chip-to-Chip Interconnection

Optimizing Buffer Usage For Networks-On-Chip Design

An Efficient and Low-Overhead Chip-to-Chip Interconnect Protocol Design for NOC