Abstract:As the graphs in our world become ever larger, the need for programmable, easy to use, and highly scalable graph processing has become ever greater. One such popular graph processing model the vertex-centric computational model does precisely this by distributing computations across the vertices of the graph being computed over. Due to this distribution of the program to the vertices of the graph, the programmer "thinks like a vertex" when writing their graph computation, with limited to no sense of shared memory and where almost all communication between each on-vertex computation must be sent over the network. Because of this inherent communication overhead in the computational model, reducing the number of messages sent while performing a given computation is a central aspect of any efforts to optimize vertex-centric programs. While previous work has focused on reducing communication overhead by directly changing communication patterns by altering the way the graph is partitioned and distributed, or by altering the graph topology itself in this paper we present a different optimization strategy based on a family of complementary compile-time program transformations in order to minimize communication overhead by changing both the messaging and computational structures of programs. Particularly, we present and formalize a method by which a compiler can automatically incrementalize a vertex-centric program through a series of compile-time program transformations by modifying the on-vertex computation and messaging between vertices so that messages between vertices represent patches to be applied to the other vertex's local state. We empirically evaluate these transformations on a set of common vertex-centric algorithms and graphs and achieve an average reduction of 2.7X in total computational time, and 2.9X in the number of messages sent across all programs in the benchmark suite. Furthermore, since these are compile-time program transformations alone, other prior optimization strategies for vertex-centric programs can work with the resulting vertex-centric program just as they would a non-incrementalized program.

Thinking Like a Vertex: a Survey of Vertex-Centric Frameworks for Distributed Graph Processing

Vertex-Centric Graph Processing: The Good, the Bad, and the Ugly

Think Like a Vertex, Behave Like a Function! a Functional DSL for Vertex-Centric Big Graph Processing

DFA-G: A Unified Programming Model for Vertex-Centric Parallel Graph Processing

A Vertex-Centric Graph Simulation Algorithm for Large Graphs.

High-Level Programming Abstractions for Distributed Graph Processing

Graphu: A Unified Vertex-Centric Parallel Graph Processing Platform

A Topology-Aware Framework for Graph Traversals.

Evaluation and Analysis of Distributed Graph-Parallel Processing Frameworks

Incrementalization of Vertex-Centric Programs

A Meta-graph Approach to Analyze Subgraph-centric Distributed Programming Models

Tuning the granularity of parallelism for distributed graph processing

DRONE: a Distributed Subgraph-Centric Framework for Processing Large Scale Power-law Graphs

VSIM: Distributed Local Structural Vertex Similarity Calculation on Big Graphs

ScaleG: A Distributed Disk-based System for Vertex-centric Graph Processing

Graph Computing Systems for Large Scale Graph Analysis

Optimizing Graph Processing on GPUs

Efficient Disk-Based Directed Graph Processing: A Strongly Connected Component Approach

A Survey of Distributed Graph Algorithms on Massive Graphs

A Topology-Adaptive Strategy for Graph Traversing

ReGraph: A Graph Processing Framework that Alternately Shrinks and Repartitions the Graph.