Abstract:In order to process complex and large-scale graph data numerous distributed graph-parallel computing platforms have been proposed. However, excessive communications among computing nodes in these systems not only aggravate the network I/O workload of the underlying computing hardware systems but may also cause a decrease in runtime performance and scalability. In this paper, we propose and implement a system called Ligraph, which computes large-scale graph data in distributed mode with lightweight communication overhead. Ligraph is similar to PowerGraph system with three new features: (1) a Gather partial sum difference based computing model; (2) a corresponding lightweight Gather communication mechanism; (3) for PageRank-like algorithms Ligraph additionally employs a lightweight synchronizing communication mechanism and an edge direction-aware graph partition strategy proposed by our former work LightGraph, which is specially designed for PageRank-like algorithms. We have conducted extensive experiments using real-world data sets, and our results verified the effectiveness of Ligraph on reducing the communication overhead and improving the runtime performance and the scalability compared with PowerGraph and LightGraph. For example, compared with PowerGraph under Random partition scenario Ligraph can not only reduce up to 35.2 percent of the communication overhead but also cut up to 21.8 percent of the runtime for PageRank algorithm while processing Twitter data set. Our experiment results also demonstrate that compared with several other representative existing systems Ligraph also outperforms them in graph computing rate.

DGLa: A Distributed Graphics Language.

Dgpsl - A Distributed Graphics Processing Support Library for Graphics and Image

Drawing and Application of GOO Single-Line Display of Distribution Network

DPGL: the Direct3D9-based Parallel Graphics Library for Multi-Display Environment

Building High Performance DVR Via HLA, Scene Graph and Parallel Rendering.

Design and implementation of a large-scale hybrid distributed graphics system.

LightGraph: Lighten Communication in Distributed Graph-Parallel Processing

Distributed graphics support for virtual environments

A Distributed Graph-Parallel Computing System with Lightweight Communication Overhead

DPGS: A Distributed Programmable Grid System

Design and implementation of a distributed shading algorithm

D3DPR: a direct3D-based large-scale display parallel rendering system architecture for clusters

GML-based Distributed and Generalized Spatial Data Engine

HIVE: a Highly Scalable Framework for DVE

PASGAL: Parallel And Scalable Graph Algorithm Library

Programming languages for distributed computing systems

DArray: A High Performance RDMA-Based Distributed Array.

DC++: a kind of object-oriented distributed programming language

A Service-Oriented Heterogeneous Geospatial Data Sharing Method in a Distributed Environment

An Universal Distributed Rendering System

DQP:A Distributed Query Processor on Grid