Abstract:Massive graph analytics have become an important aspect of multiple diverse applications. With the growing scale of real world graphs, efficient execution of entire graph analytics has become a challenging problem. Recently a number of distributed graph processing systems (Pregel, PowerGraph, Trinity) and centralized systems (GraphChi and XStream) have been designed. Compared with high expense of distributed systems deployed on a cluster of commodity machines, the centralized systems on cheap PCs are very attractive propositions with low expense and comparable performance. By careful analysis, we find that (i) the graph computation abstraction in the centralized systems inherently adopted a batch model similar to the distributed systems. The batch model could lead to suboptimal performance. (ii) The execution model in the centralized systems advocates sequential operations on Solid State Disk (SSD) which are still slower than memory-based operations. In order to tackle the above efficiency issues in centralized systems, we first propose a novel continuous graph computation abstraction. This model continuously processes edges and updates computation results. It allows much faster convergence than the batch model. Second, we propose to maintain vertex states in memory and advocates memory-based operations for much faster I/O operations than sequential operations on SSD. Finally, we design an adaptive memory layout to minimize overall I/O cost. We develop a proof of concept prototype L-Graph and implement four example graph analytic applications atop L-Graph. Preliminary evaluation on real and synthetic graphs have verified that the proposed continuous model greatly performs the widely used batch model and L-Graph can achiever much higher efficiency than the state of arts GraphChi.

Pregel Algorithms for Graph Connectivity Problems with Performance Guarantees

An Efficient Graph Processing System

Computing Connected Components with Linear Communication Cost in Pregel-Like Systems.

Tuning the granularity of parallelism for distributed graph processing

Distributed computing connected components with linear communication cost

Frequent Subgraph Mining Based on Pregel.

An Efficient Parallel Algorithm of N-hop Neighborhoods on Graphs in Distributed Environment

An Efficient Iterative Graph Data Processing Framework Based on Bulk Synchronous Parallel Model

Hierarchical Parallelization and Runtime Scheduling for Pregel-Like Graph Processing Systems

Efficient Processing of Very Large Graphs in a Small Cluster

Vertex-Centric Graph Processing: The Good, the Bad, and the Ugly

Graph Computing Systems for Large Scale Graph Analysis

Survey on Technologies of Distributed Graph Processing Systems

L-Graph

A Distributed Graph-Parallel Computing System with Lightweight Communication Overhead

VPC: Pruning Connected Components Using Vector-Based Path Compression for Graph500

LightGraph: Lighten Communication in Distributed Graph-Parallel Processing

Lcc-Graph: A High-Performance Graph-Processing Framework with Low Communication Costs

A communication-reduced and computation-balanced framework for fast graph computation

Strongly Connected Components Based Efficient PPR Algorithms

A BSP Model Graph Processing System on Many Cores