Abstract:Over the past decade, microprocessor design strategies have focused on increasing the computational power on a single chip. Because computations often require more data from cache per floating-point operation than a machine can deliver and because operations are pipelined, idle computational cycles are common when scientific applications are executed. To overcome these bottlenecks, programmers have learned to use a coding style that ensures a better balance between memory references and floating-point operations. In our view, this is a step in the wrong direction because it makes programs more machine-specific. A programmer should not be required to write a new program version for each new machine; instead, the task of specializing a program to a target machine should be left to the compiler. But is our view practical? Can a sophisticated optimizing compiler obviate the need for the myriad of programming tricks that have found their way into practice to improve the performance of the memory hierarchy? In this paper we attempt to answer that question. To do so, we develop and evaluate techniques that automatically restructure program loops to achieve high performance on specific target architectures. These methods attempt to balance computation and memory accesses and seek to eliminate or reduce pipeline interlock. To do this, they estimate statically the balance between memory operations and floating-point operations for each loop in a particular program and use these estimates to determine whether to apply various loop transformations. Experiments with our automatic techniques show that integer-factor speedups are possible on kernels. Additionally, the estimate of the balance between memory operations and computation, and the application of the estimate are very accurate—experiments reveal little difference between the balance achieved by our automatic system that is made possible by hand optimization.

An Effectively $Ω(c)$ Language and Runtime

Operational Aspects of C/C++ Concurrency

Improving the ratio of memory operations to floating-point operations in loops

Optimizing Logical Execution Time Model for Both Determinism and Low Latency

Asymptotic speedup via effect handlers

CAMLroot: revisiting the OCaml FFI

EOLANG and $φ$-calculus

Redesigning OP2 Compiler to Use HPX Runtime Asynchronous Techniques

The Problem of Programming Language Concurrency Semantics

A Tale of Three Runtimes

Just-In-Time Locality and Percolation for Optimizing Irregular Applications on A Manycore Architecture

Improving productivity in large scale testing at the compiler level by changing the intermediate language from C++ to Java

Separation of concerning things: a simpler basis for defining and programming with the C/C++ memory model (extended version)

Future Directions for Optimizing Compilers

A Platform for Developing Adaptable Multicore Applications

Language Constructs and Semantics for Runtime-independent Parallelism Expression on Heterogeneous Systems

Lowering the Volatility: a Practical Cache Allocation Prediction and Stability-Oriented Co-Runner Scheduling Algorithms

Tightening I/O Lower Bounds through the Hourglass Dependency Pattern

A Language for Describing Optimization Strategies

Practical partial evaluation for high-performance dynamic language runtimes

CryptOpt: Automatic Optimization of Straightline Code