The Node-Similarity Distribution of Complex Networks and Its Applications in Link Prediction
Cunlai Pu,Jie Li,Jian Wang,Tony Q. S. Quek,Tony Q.S. Quek
DOI: https://doi.org/10.1109/tkde.2020.3026311
IF: 9.235
2021-01-01
IEEE Transactions on Knowledge and Data Engineering
Abstract:Over the years, quantifying the similarity of nodes has been a hot topic in network science, yet little has been known about the distribution of node-similarity. In this paper, we consider a typical measure of node-similarity called the common neighbor based similarity (CNS). By means of the generating function, we propose a general framework for calculating the CNS distributions of node sets in various networks. Particularly, we show that for the Erdös-Rényi random network, the CNS distribution of node sets of any size obeys the Poisson law. Furthermore, we connect the node-similarity distribution to the link prediction problem, and derive analytical solutions for two key evaluation metrics: i) precision and ii) area under the receiver operating characteristic curve (AUC). We also use the similarity distributions to optimize link prediction by i) deriving the expected prediction accuracy of similarity scores and ii) providing the optimal prediction priority of unconnected node pairs. Simulation results confirm our theoretical findings and also validate the proposed tools in evaluating and optimizing link prediction.
computer science, information systems, artificial intelligence,engineering, electrical & electronic