Abstract:Personalized PageRank (PPR) has wide applications in search engines, social recommendations, community detection, and so on. Nowadays, graphs are becoming massive and many IT companies need to deal with large graphs that cannot be fitted into the memory of most commodity servers. However, most existing state-of-the-art solutions for PPR computation only work for single-machines and are inefficient for the distributed framework since such solutions either (i) result in an excessively large number of communication rounds, or (ii) incur high communication costs in each round. Motivated by this, we present Delta-Push , an efficient framework for single-source and top- k PPR queries in distributed settings. Our goal is to reduce the number of rounds while guaranteeing that the load, i.e., the maximum number of messages an executor sends or receives in a round, can be bounded by the capacity of each executor. We first present a non-trivial combination of a redesigned parallel push algorithm and the Monte-Carlo method to answer single-source PPR queries. The solution uses pre-sampled random walks to reduce the number of rounds for the push al6gorithm. Theoretical analysis under the Massively Parallel Computing (MPC) model shows that our proposed solution bounds the communication rounds to [EQUATION] under a load of O ( m/p ), where m is the number of edges of the input graph, p is the number of executors, and ϵ is a user-defined error parameter. In the meantime, as the number of executors increases to p' = γ · p , the load constraint can be relaxed since each executor can hold O (γ · m/p' ) messages with invariant local memory. In such scenarios, multiple queries can be processed in batches simultaneously. We show that with a load of O (γ · m/p' ), our Delta-Push can process γ queries in a batch with [EQUATION] rounds, while other baseline solutions still keep the same round cost for each batch. We further present a new top- k algorithm that is friendly to the distributed framework and reduces the number of rounds required in practice. Extensive experiments show that our proposed solution is more efficient than alternatives.

A Lock-Free Approach to Parallelizing Personalized PageRank Computations on GPU

Massively Parallel Algorithms for Personalized Pagerank

Accelerating Personalized PageRank Vector Computation

Two Parallel PageRank Algorithms via Improving Forward Push

PowerWalk: Scalable Personalized PageRank via Random Walks with Vertex-Centric Decomposition

Research On Parallel Algorithm Of Pagerank Based On Gpu

Strongly Connected Components Based Efficient PPR Algorithms

Unifying the Global and Local Approaches: an Efficient Power Iteration with Forward Push

Load-Balanced Breadth-First Search On Gpus

Efficient GPU Implementation of Static and Incrementally Expanding DF-P PageRank for Dynamic Graphs

Lock-based synchronization for GPU architectures.

Efficient Parallel Lists Intersection And Index Compression Algorithms Using Graphics Processing Units

Efficient Algorithms for Approximate Single-Source Personalized PageRank Queries.

Efficient Algorithms for Personalized PageRank Computation: A Survey

Locality-aware Thread Block Design in Single and Multi-GPU Graph Processing

Distributed Algorithms on Exact Personalized PageRank

A parallel implementation of nearest neighbor analysis based on GPGPU

Efficient GPU-Based Query Processing with Pruned List Caching in Search Engines.

Lock-Free Computation of PageRank in Dynamic Graphs

A Parallel Strategy to Accelerate Neighborhood Operation for Raster Data Coordinating CPU and GPU

Edge-based Local Push for Personalized PageRank