Abstract:Silicon technology will continue to provide an exponential increase in the availability of raw transistors. Effectively translating this resource into application performance, however, is an open challenge that conventional superscalar designs will not be able to meet. We present WaveScalar as a scalable alternative to conventional designs. WaveScalar is a dataflow instruction set and execution model designed for scalable, low-complexity/high-performance processors. Unlike previous dataflow machines, WaveScalar can efficiently provide the sequential memory semantics that imperative languages require. To allow programmers to easily express parallelism, WaveScalar supports pthread-style, coarse-grain multithreading and dataflow-style, fine-grain threading. In addition, it permits blending the two styles within an application, or even a single function. To execute WaveScalar programs, we have designed a scalable, tile-based processor architecture called the WaveCache. As a program executes, the WaveCache maps the program's instructions onto its array of processing elements (PEs). The instructions remain at their processing elements for many invocations, and as the working set of instructions changes, the WaveCache removes unused instructions and maps new ones in their place. The instructions communicate directly with one another over a scalable, hierarchical on-chip interconnect, obviating the need for long wires and broadcast communication. This article presents the WaveScalar instruction set and evaluates a simulated implementation based on current technology. For single-threaded applications, the WaveCache achieves performance on par with conventional processors, but in less area. For coarse-grain threaded applications the WaveCache achieves nearly linear speedup with up to 64 threads and can sustain 7--14 multiply-accumulates per cycle on fine-grain threaded versions of well-known kernels. Finally, we apply both styles of threading to equake from Spec2000 and speed it up by 9x compared to the serial version.

Sapphire Rapids: The Next-Generation Intel Xeon Scalable Processor

Skylake-Sp: A 14nm 28-Core Xeon (R) Processor

A Quantitative Analysis and Guidelines of Data Streaming Accelerator in Modern Intel Xeon Scalable Processors

A Scalable Network-on-Chip Microprocessor With 2.5D Integrated Memory and Accelerator.

A 65nm 39GOPS/W 24-Core Processor with 11tb/s/w Packet-Controlled Circuit-Switched Double-Layer Network-on-chip and Heterogeneous Execution Array

A Scalable And Reconfigurable 2.5d Integrated Multicore Processor On Silicon Interposer

Xuantie-910: A Commercial Multi-Core 12-Stage Pipeline Out-of-Order 64-Bit High Performance RISC-V Processor with Vector Extension : Industrial Product

Microarchitectural comparison and in-core modeling of state-of-the-art CPUs: Grace, Sapphire Rapids, and Genoa

A 920mhz Quad-Core Cryptography Processor Accelerating Parallel Task Processing Of Public-Key Algorithms

Demystifying CXL Memory with Genuine CXL-Ready Systems and Devices

A 1.2 TB/s on-chip ring interconnect for 45nm 8-core enterprise Xeon® processor

AMD InstinctTM MI250X Accelerator enabled by Elevated Fanout Bridge Advanced Packaging Architecture

A 16-Core Processor With Shared-Memory and Message-Passing Communications

Sapphire: A Configurable Crypto-Processor for Post-Quantum Lattice-based Protocols

On the Extreme Parallelism Inside Next-Generation Network Processors

Performance characterisation of the 64-core SG2042 RISC-V CPU for HPC

A 167-Processor 65 Nm Computational Platform with Per-Processor Dynamic Supply Voltage and Dynamic Clock Frequency Scaling

An 800mhz 320mw 16-Core Processor with Message-Passing and Shared-Memory Inter-Core Communication Mechanisms

The WaveScalar architecture

A 10Gbps in-line Network Security Processor with a 32-bit embedded CPU

Understanding HPC Benchmark Performance on Intel Broadwell and Cascade Lake Processors