Abstract:Systolic arrays and shared-L1-memory manycore clusters are commonly used architectural paradigms that offer different trade-offs to accelerate parallel workloads. While the first excel with regular dataflow at the cost of rigid architectures and complex programming models, the second are versatile and easy to program but require explicit dataflow management and synchronization. This work aims at enabling efficient systolic execution on shared-L1-memory manycore clusters. We devise a flexible architecture where small and energy-efficient RISC-V cores act as the systolic array's processing elements (PEs) and can form diverse, reconfigurable systolic topologies through queues mapped in the cluster's shared memory. We introduce two low-overhead RISC-V instruction set architecture (ISA) extensions for efficient systolic execution, namely Xqueue and queue-linked registers (QLRs), which support queue management in hardware. The Xqueue extension enables single-instruction access to shared-memory-mapped queues, while QLRs allow implicit and autonomous access to them, relieving the cores of explicit communication instructions. We demonstrate Xqueue and QLRs in MemPool, an open-source shared-memory cluster with 256 PEs, and analyze the hybrid systolic-shared-memory architecture's trade-offs on several digital signal processing (DSP) kernels with diverse arithmetic intensity. For an area increase of just 6%, our hybrid architecture can double MemPool's compute unit utilization, reaching up to 73%. In typical conditions (TT/0.80 V/25 °C), in a 22-nm FDX technology, our hybrid architecture runs at 600 MHz with no frequency degradation and is up to 65% more energy efficient than the shared-memory baseline, achieving up to 208 GOPS/W, with up to 63% of power spent in the PEs.

Amdahl's and Hill-Marty Laws Revisited for FPGA-based MPSoCs: from Theory to Practice.

Analyzing Parallelization and Program Performance in Heterogeneous MPSoCs

Using Amdahl's Law for Performance Analysis of Many-Core SoC Architectures Based on Functionally Asymmetric Processors

Extending Amdahl's Law in the Multicore Era

A Scalable Hybrid Architecture for High Performance Data-Parallel Applications

Seeing Shapes in Clouds: On the Performance-Cost trade-off for Heterogeneous Infrastructure-as-a-Service

MultiAmdahl: Optimal Resource Allocation in Heterogeneous Architectures

Optimizing Offload Performance in Heterogeneous MPSoCs

Enabling Efficient Hybrid Systolic Computation in Shared-L1-Memory Manycore Clusters

Enabling Efficient Hybrid Systolic Computation in Shared L1-Memory Manycore Clusters

Integrating Amdahl-like Laws and Divisible Load Theory

High-performance computing: Transitioning from Instruction-Level Parallelism to heterogeneous hybrid architectures

A Ubiquitous Machine Learning Accelerator With Automatic Parallelization on FPGA

Processes Scheduling on Heterogeneous Multi-core Architecture with Hardware Support.

A Hybrid Approach to Cache Management in Heterogeneous CPU-FPGA Platforms.

How Amdahl's low restricts supercomputer applications and building ever bigger supercomputers

Hardware Implementation on FPGA for Task-Level Parallel Dataflow Execution Engine.

Optimization of Lattice Boltzmann Simulations on Heterogeneous Computers

A Study of FPGA Virtualization and Accelerator Scheduling

Accelerating Graph Analytics by Co-Optimizing Storage and Access on an FPGA-HMC Platform

Performance evaluation based on task division and scheduling in heterogeneous multi-core systems