Abstract:With the availability of chip multiprocessor (CMP) and simultaneous multithreading (SMT) machines, extracting thread level parallelism from a sequential program has become crucial for improving performance. However, many sequential programs cannot be easily parallelized due to the presence of dependences. To solve this problem, different solutions have been proposed. Some of them make the optimistic assumption that such dependences rarely manifest themselves at runtime. However, when this assumption is violated, the recovery causes very large overhead. Other approaches incur large synchronization or computation overhead when resolving the dependences. Consequently, for a loop with frequently arising cross-iteration dependences, previous techniques are not able to speed up the execution. In this paper we propose a compiler technique which uses state separation and multiple value prediction to speculatively parallelize loops in sequential programs that contain frequently arising cross-iteration dependences. The key idea is to generate multiple versions of a loop iteration based on multiple predictions of values of variables involved in cross-iteration dependences (i.e., live-in variables). These speculative versions and the preceding loop iteration are executed in separate memory states simultaneously. After the execution, if one of these versions is correct (i.e., its predicted values are found to be correct), then we merge its state and the state of the preceding iteration because the dependence between the two iterations is correctly resolved. The memory states of other incorrect versions are completely discarded. Based on this idea, we further propose a runtime adaptive scheme that not only gives a good performance but also achieves better CPU utilization. We conducted experiments on 10 benchmark programs on a real machine. The results show that our technique can achieve 1.7x speedup on average across all used benchmarks.

An Online Profile Guided Optimization Approach For Speculative Parallel Threading

Balancing Thread Partition for Efficiently Exploiting Speculative Thread-Level Parallelism

A Static Greedy and Dynamic Adaptive Thread Spawning Approach for Loop-Level Parallelism

Speculative Parallelization Using State Separation and Multiple Value Prediction.

Optimization Strategies Oriented to Loop Characteristics in Software Thread Level Speculation Systems

A Graph-Based Thread Partition Approach in Speculative Multithreading

Speculative Parallelization of Sequential Loops on Multicores

A Loop Selection Approach Based on Performance Prediction for Speculative Multithreading

Dynamically Spawning Speculative Threads to Improve Speculative Path Execution.

A new thread-level speculative automatic parallelization model and library based on duplicate code execution

Online Thread Auto-Tuning for Performance Improvement and Resource Saving

A Novel Thread Partitioning Approach Based on Machine Learning for Speculative Multithreading

Profiling Based Optimization Method for CPU-GPU Heterogeneous Parallel Processing System

Mis-speculation-Driven Compiler Framework for Aggressive Loop Automatic Parallelization

A Dynamically Adaptive Approach for Speculative Loop Execution in SMT Architectures

Reverse Compilation for Speculative Parallel Threading

Loop Selection to Boost Thread Level Speculation Parallelism in Chip Multiprocessor Systems

Investigation of Factors Impacting Thread-Level Parallelism from Desktop, Multimedia and HPC Applications

A cost estimation based speculative path determination method for speculative thread partitioning

Coarse-Grained Task Parallelization by Dynamic Profiling for Heterogeneous SoC-Based Embedded System

Position-aware Thread-Level Speculative Parallelization for Large-Scale Chip-Multiprocessor.