Abstract:The increasing complexity of computing systems places a tremendous burden on optimizing compilers, requiring ever more accurate and aggressive optimizations. Machine learning offers significant benefits for constructing optimization heuristics but there remains a gap between what state-of-the-art methods achieve and the performance of an optimal heuristic. Closing this gap requires improvements in two key areas: a representation that accurately captures the semantics of programs, and a model architecture with sufficient expressiveness to reason about this representation. We introduce ProGraML - Program Graphs for Machine Learning - a novel graph-based program representation using a low level, language agnostic, and portable format; and machine learning models capable of performing complex downstream tasks over these graphs. The ProGraML representation is a directed attributed multigraph that captures control, data, and call relations, and summarizes instruction and operand types and ordering. Message Passing Neural Networks propagate information through this structured representation, enabling whole-program or per-vertex classification tasks. ProGraML provides a general-purpose program representation that equips learnable models to perform the types of program analysis that are fundamental to optimization. To this end, we evaluate the performance of our approach first on a suite of traditional compiler analysis tasks: control flow reachability, dominator trees, data dependencies, variable liveness, and common subexpression detection. On a benchmark dataset of 250k LLVM-IR files covering six source programming languages, ProGraML achieves an average 94.0 F1 score, significantly outperforming the state-of-the-art approaches. We then apply our approach to two high-level tasks - heterogeneous device mapping and program classification - setting new state-of-the-art performance in both.

Pregel Meets Uncal: A Systematic Framework for Transforming Big Graphs

Towards Systematic Parallelization of Graph Transformations over Pregel.

Processing UnQL Graph Queries with Pregel

Let High-level Graph Queries Be Parallel Efficient: an Approach over Structural Recursion on Pregel.

An Efficient Graph Processing System

Tuning the granularity of parallelism for distributed graph processing

Bidirectionalizing Graph Transformations

Parameterized Graph Transformation Languages with Monads

Transforming Property Graphs

Marker-directed Optimization of UnCAL Graph Transformations (revised version)

Graph-transformation verification using monadic second-order logic

Marker-Directed optimization of UnCAL graph transformations

Graph Programming Interface (GPI): A Linear Algebra Programming Model for Large Scale Graph Computations

Bidirectionalizing Structural Recursion on Graphs Soichiro Hidaka Zhenjiang

GLog: A high level graph analysis system using MapReduce

Can Graph Transformation be Bidirectionalized? Bidirectional Semantics of Structural Recursion on Graphs

ProGraML: Graph-based Deep Learning for Program Optimization and Analysis

Bidirectionalizing Structural Recursion on Graphs Soichiro Hidaka

A parameterized graph transformation calculus for finite graphs with monadic branches

Graph Computing Systems for Large Scale Graph Analysis