Abstract:Silicon technology will continue to provide an exponential increase in the availability of raw transistors. Effectively translating this resource into application performance, however, is an open challenge that conventional superscalar designs will not be able to meet. We present WaveScalar as a scalable alternative to conventional designs. WaveScalar is a dataflow instruction set and execution model designed for scalable, low-complexity/high-performance processors. Unlike previous dataflow machines, WaveScalar can efficiently provide the sequential memory semantics that imperative languages require. To allow programmers to easily express parallelism, WaveScalar supports pthread-style, coarse-grain multithreading and dataflow-style, fine-grain threading. In addition, it permits blending the two styles within an application, or even a single function. To execute WaveScalar programs, we have designed a scalable, tile-based processor architecture called the WaveCache. As a program executes, the WaveCache maps the program's instructions onto its array of processing elements (PEs). The instructions remain at their processing elements for many invocations, and as the working set of instructions changes, the WaveCache removes unused instructions and maps new ones in their place. The instructions communicate directly with one another over a scalable, hierarchical on-chip interconnect, obviating the need for long wires and broadcast communication. This article presents the WaveScalar instruction set and evaluates a simulated implementation based on current technology. For single-threaded applications, the WaveCache achieves performance on par with conventional processors, but in less area. For coarse-grain threaded applications the WaveCache achieves nearly linear speedup with up to 64 threads and can sustain 7--14 multiply-accumulates per cycle on fine-grain threaded versions of well-known kernels. Finally, we apply both styles of threading to equake from Spec2000 and speed it up by 9x compared to the serial version.

SpMT WaveCache: Exploiting Thread-Level Parallelism in WaveScalar

Shared Write Buffer to Boost Applications on SpMT Architecture

Shared Write Buffer To Support Data Sharing Among Speculative Multi-Threading Cores

Shared Write Buffer to Support Speculative Execution

The WaveScalar architecture

Transactional WaveCache: Towards Speculative and Out-of-Order DataFlow Execution of Memory Operations

SPMTM: A Novel ScratchPad Memory Based Hybrid Nested Transactional Memory Framework

Prophet: A Speculative Multi-threading Execution Model with Architectural Support Based on CMP

A Thread Partitioning Method for Speculative Multithreading

Performance Evaluation and Optimization of Cache Architecture for Simultaneous Multithreading Processor

Position-aware Thread-Level Speculative Parallelization for Large-Scale Chip-Multiprocessor.

Dynamic Partitioning of Scalable Cache Memory for SMT Architectures

Compiler-directed scratchpad memory data transfer optimization for multithreaded applications on a heterogeneous many-core architecture

Vscp: A Cache Controlling Method for Improving Single Thread Performance in Multicore System

Mtsdt: Multithreaded Software Dynamic Translator for Multi-Core System

Prophet+:an Extended Multicore Simulator for Speculative Multithreading

Boosting SMT trace processors performance with data cache misssensitive thread scheduling mechanism

A Hybrid Sample Generation Approach in Speculative Multithreading

Logspotm: A Scalable Thread Level Speculation Model Based on Transactional Memory

A sparse matrix vector multiplication accelerator based on high-bandwidth memory

Cache Coherence Method for Improving Multi-threaded Applications on Multicore Systems