Abstract:With the availability of chip multiprocessor (CMP) and simultaneous multithreading (SMT) machines, extracting thread level parallelism from a sequential program has become crucial for improving performance. However, many sequential programs cannot be easily parallelized due to the presence of dependences. To solve this problem, different solutions have been proposed. Some of them make the optimistic assumption that such dependences rarely manifest themselves at runtime. However, when this assumption is violated, the recovery causes very large overhead. Other approaches incur large synchronization or computation overhead when resolving the dependences. Consequently, for a loop with frequently arising cross-iteration dependences, previous techniques are not able to speed up the execution. In this paper we propose a compiler technique which uses state separation and multiple value prediction to speculatively parallelize loops in sequential programs that contain frequently arising cross-iteration dependences. The key idea is to generate multiple versions of a loop iteration based on multiple predictions of values of variables involved in cross-iteration dependences (i.e., live-in variables). These speculative versions and the preceding loop iteration are executed in separate memory states simultaneously. After the execution, if one of these versions is correct (i.e., its predicted values are found to be correct), then we merge its state and the state of the preceding iteration because the dependence between the two iterations is correctly resolved. The memory states of other incorrect versions are completely discarded. Based on this idea, we further propose a runtime adaptive scheme that not only gives a good performance but also achieves better CPU utilization. We conducted experiments on 10 benchmark programs on a real machine. The results show that our technique can achieve 1.7x speedup on average across all used benchmarks.

A Parallel Algorithm for Instruction Dependence Graph Analysis Based on Multithreading

Scalable-Grain Pipeline Parallelization Method For Multi-Core Systems

Effective and efficient microprocessor design space exploration using unlabeled design configurations

Offline Data Dependence Analysis to Facilitate Runtime Parallelism Extraction

A Parallel Dynamic Programming Algorithm on a Multi-Core Architecture

Inter-procedural static slicing of concurrent programs based on threaded System Dependence Graph (tSDG)

A dependence graph pattern mining method for processor performance analysis

Asynchronous Parallel Dijkstra's Algorithm on Intel Xeon Phi Processor - How to Accelerate Irregular Memory Access Algorithm.

Energy-Aware Loop Parallelism Maximization for Multi-core DSP Architectures

Parallel AIG Refactoring via Conflict Breaking

Source-code-level Transformation and APT-Driven Parallelism Pre-processes for Embedded System Automated Design

Speculative Parallelization Using State Separation and Multiple Value Prediction.

Multicore Parallel Min-Cost Flow Algorithm for CAD Applications

Characterizing Fine-Grain Parallelism on Modern Multicore Platform

Optimizing Scheduling Technology for Clustered VLIW Architectures Using Data Dependence Graph

Dependency-Aware Parallel Routing for Large-Scale FPGAs

Compile-Time Scheduling Of Multithread With Data Localities On Multiple Vector Processors

Dependency Graph-based High-level Synthesis for Maximum Instruction Parallelism

A Theoretical Research on Program Instruction Level Parallelism to Guide Microprocessor Design

An Approach to Analyzing Dependence of Concurrent Programs Based on Program Reachability Graphs

Shared Register File Based ILP for Multicore