Abstract:Computing distances and finding shortest paths in massive real-world networks is a fundamental algorithmic task in network analysis. There are two main approaches to solving this task. On one hand are traversal-based algorithms like bidirectional breadth-first search (BiBFS) with no preprocessing step and slow individual distance inquiries. On the other hand are indexing-based approaches, which maintain a large index. This allows for answering individual inquiries very fast; however, index creation is prohibitively expensive. We seek to bridge these two extremes: quickly answer distance inquiries without the need for costly preprocessing. In this work, we propose a new algorithm and data structure, WormHole, for approximate shortest path computations. WormHole leverages structural properties of social networks to build a sublinearly sized index, drawing upon the explicit core-periphery decomposition of Ben-Eliezer et al. Empirically, the preprocessing time of WormHole improves upon index-based solutions by orders of magnitude, and individual inquiries are consistently much faster than in BiBFS. The acceleration comes at the cost of a minor accuracy trade-off. Nonetheless, our empirical evidence demonstrates that WormHole accurately answers essentially all inquiries within a maximum additive error of 2. We complement these empirical results with provable theoretical guarantees, showing that WormHole requires $n^{o(1)}$ node queries per distance inquiry in random power-law networks. In contrast, any approach without a preprocessing step requires $n^{\Omega(1)}$ queries for the same task. WormHole does not require reading the whole graph. Unlike the vast majority of index-based algorithms, it returns paths, not just distances. For faster inquiry times, it can be combined effectively with other index-based solutions, by running them only on the sublinear core.

Fast Query of Biharmonic Distance in Networks

Accelerating Exact Nearest Neighbor Search in High Dimensional Euclidean Space Via Block Vectors

Biharmonic Distance Related Centrality for Edges in Weighted Networks

Biharmonic Distance of Graphs and its Higher-Order Variants: Theoretical Properties with Applications to Centrality and Clustering

A Sublinear Algorithm for Approximate Shortest Paths in Large Networks

Efficient Approximate Algorithms for the Closest Pair Problem in High Dimensional Spaces.

Biharmonic Distance-Based Performance Metric for Second-Order Noisy Consensus Networks.

Lower Bounds on Rate of Convergence of Matrix Products in All Pairs Shortest Path of Social Network

Distributed Finite-Time Estimation of the Bounds on Algebraic Connectivity for Directed Graphs

Toward a distance oracle for billion-node graphs

Efficient Betweenness Centrality Computation over Large Heterogeneous Information Networks

Average Distance of Random Bipartite Matching in Discrete Networks

Exact and Approximate Algorithms for Computing Betweenness Centrality in Directed Graphs

BIRD: Efficient Approximation of Bidirectional Hidden Personalized PageRank

Bipartite-Oriented Distributed Graph Partitioning for Big Learning

Towards Distributed Node Similarity Search on Graphs

Learn Low-dimensional Shortest-path Representation of Large-scale and Complex Graphs

Network Distance Based on Laplacian Flows on Graphs

A Fast Parallel Approach for Neighborhood-based Link Prediction by Disregarding Large Hubs

Multidimensional Similarity In-network Query for Large-Scale Sensor Networks

Fast Distributed Computation of Distances in Networks