A Scalable Redefined Stochastic Blockmodel
Xueyan Liu,Bo Yang,Hechang Chen,Katarzyna Musial,Hongxu Chen,Yang Li,Wanli Zuo
DOI: https://doi.org/10.1145/3442589
IF: 4.157
2021-04-12
ACM Transactions on Knowledge Discovery from Data
Abstract:Stochastic blockmodel (SBM) is a widely used statistical network representation model, with good interpretability, expressiveness, generalization, and flexibility, which has become prevalent and important in the field of network science over the last years. However, learning an optimal SBM for a given network is an NP-hard problem. This results in significant limitations when it comes to applications of SBMs in large-scale networks, because of the significant computational overhead of existing SBM models, as well as their learning methods. Reducing the cost of SBM learning and making it scalable for handling large-scale networks, while maintaining the good theoretical properties of SBM, remains an unresolved problem. In this work, we address this challenging task from a novel perspective of model redefinition. We propose a novel redefined SBM with Poisson distribution and its block-wise learning algorithm that can efficiently analyse large-scale networks. Extensive validation conducted on both artificial and real-world data shows that our proposed method significantly outperforms the state-of-the-art methods in terms of a reasonable trade-off between accuracy and scalability. 1
computer science, information systems, software engineering