An Adaptive Sharing Framework for Efficient Multi-source Shortest Path Computation

Xinyi Liu,Zhigang Wang,Ning Wang,Xiangtan Li,Bo Zhang,Jun Qiao,Zhiqiang Wei,Jie Nie
DOI: https://doi.org/10.1007/978-3-030-87571-8_55
2021-01-01
Abstract:Many real-world applications need to know the distances between some or all pairs of vertices in a large graph, but the existing distributed single-source shortest path (SSSP) solution can not efficiently handle the problem of such multi-source computation. While, distributed multi-source shortest path (MSSP) has not attracted enough attention. This paper thereby proposes a distributed multi-source shortest path algorithm by scheduling source vertices in different batches and sharing graph traversal operations in the same batch for efficiency (BMSSP), which effectively solves the performance bottleneck of MSSP on big graphs. To correctly run multi source vertices in the same batch, a message cluster mechanism is designed to effectively manage the communication. A further analysis reveals that the overall performance of B-MSSP is affected by the batch size. Thus, an adaptive cost-benefit model is proposed to quickly and easily select a proper batch size for better performance. Extensive experiments over lots of real graphs validate the efficiency and effectiveness of our proposals.
What problem does this paper attempt to address?