Abstract:With the availability of chip multiprocessor (CMP) and simultaneous multithreading (SMT) machines, extracting thread level parallelism from a sequential program has become crucial for improving performance. However, many sequential programs cannot be easily parallelized due to the presence of dependences. To solve this problem, different solutions have been proposed. Some of them make the optimistic assumption that such dependences rarely manifest themselves at runtime. However, when this assumption is violated, the recovery causes very large overhead. Other approaches incur large synchronization or computation overhead when resolving the dependences. Consequently, for a loop with frequently arising cross-iteration dependences, previous techniques are not able to speed up the execution. In this paper we propose a compiler technique which uses state separation and multiple value prediction to speculatively parallelize loops in sequential programs that contain frequently arising cross-iteration dependences. The key idea is to generate multiple versions of a loop iteration based on multiple predictions of values of variables involved in cross-iteration dependences (i.e., live-in variables). These speculative versions and the preceding loop iteration are executed in separate memory states simultaneously. After the execution, if one of these versions is correct (i.e., its predicted values are found to be correct), then we merge its state and the state of the preceding iteration because the dependence between the two iterations is correctly resolved. The memory states of other incorrect versions are completely discarded. Based on this idea, we further propose a runtime adaptive scheme that not only gives a good performance but also achieves better CPU utilization. We conducted experiments on 10 benchmark programs on a real machine. The results show that our technique can achieve 1.7x speedup on average across all used benchmarks.

HEAVY TAILS IN QUEUING SYSTEMS: IMPACT OF PARAL- LELISM ON TAIL PERFORMANCE

Heavy Tails in Queueing Systems: Impact of Parallelism on Tail Performance

Can Multipath Mitigate Power Law Delays? - Effects of Parallelism on Tail Performance

Time-sharing Parallel Applications Through Performance-Targeted Feedback-Controlled Real-Time Scheduling.

Taming Tail Latency for Erasure-Coded, Distributee Storage Systems

Optimizing Availability and QoS of Heterogeneous Distributed System Based on Residual Lifetime in Uncertain Environment

Fairness in overloaded parallel queues

Efficient parallel algorithms for tandem queueing system simulation

Parallel Execution of Non-Do Loops

Exponential Tail Bounds on Queues: A Confluence of Non-Asymptotic Heavy Traffic and Large Deviations

Heavy Loads and Heavy Tails

Straggler Mitigation by Delayed Relaunch of Tasks

Tail quantile estimation for non-preemptive priority queues

Tail Index for a Distributed Storage System with Pareto File Size Distribution.

Speculative Parallelization Using State Separation and Multiple Value Prediction.

Exploring Predictable Redundant Instruction Parallelism in Fault Tolerant Microprocessors

Improving performance of parallel transaction processing systems by balancing data load on line

Straggler Mitigation at Scale

Toward Optimal Operator Parallelism for Stream Processing Topology with Limited Buffers

TAIL PROBABILITIES IN QUEUEING PROCESSES

Efficient Fault-Tolerant Scheduling on Multiprocessor Systems Via Replication and Deallocation