A Simple Yet Effective Balanced Edge Partition Model for Parallel Computing
Lingda Li,Robel Geda,Ari B. Hayes,Yanhao Chen,Pranav Chaudhari,Eddy Z. Zhang,Mario Szegedy
DOI: https://doi.org/10.1145/3084451
2017-06-13
Proceedings of the ACM on Measurement and Analysis of Computing Systems
Abstract:Graph edge partition models have recently become an appealing alternative to graph vertex partition models for distributed computing due to their flexibility in balancing loads and their performance in reducing communication cost [6, 16]. In this paper, we propose a simple yet effective graph edge partitioning algorithm. In practice, our algorithm provides good partition quality (and better than similar state-of-the-art edge partition approaches, at least for power-law graphs) while maintaining low partition overhead. In theory, previous work [6] showed that an approximation guarantee of O ( d max √ log n log k ) apply to the graphs with m =Ω( k 2 ) edges ( k is the number of partitions). We further rigorously proved that this approximation guarantee hold for all graphs. We show how our edge partition model can be applied to parallel computing. We draw our example from GPU program locality enhancement and demonstrate that the graph edge partition model does not only apply to distributed computing with many computer nodes, but also to parallel computing in a single computer node with a many-core processor.