Abstract:Singular Value Decomposition (SVD) is a popular approach in various network applications, such as link prediction and network parameter characterization. Incremental SVD approaches are proposed to process newly changed nodes and edges in dynamic networks. However, incremental SVD approaches suffer from serious error accumulation inevitably due to approximation on incremental updates. SVD restart is an effective approach to reset the aggregated error, but when to restart SVD for dynamic networks is not addressed in literature. In this paper, we propose TIMERS, Theoretically Instructed Maximum-Error-bounded Restart of SVD, a novel approach which optimally sets the restart time in order to reduce error accumulation in time. Specifically, we monitor the margin between reconstruction loss of incremental updates and the minimum loss in SVD model. To reduce the complexity of monitoring, we theoretically develop a lower bound of SVD minimum loss for dynamic networks and use the bound to replace the minimum loss in monitoring. By setting a maximum tolerated error as a threshold, we can trigger SVD restart automatically when the margin exceeds this threshold. We prove that the time complexity of our method is linear with respect to the number of local dynamic changes, and our method is general across different types of dynamic networks. We conduct extensive experiments on several synthetic and real dynamic networks. The experimental results demonstrate that our proposed method significantly outperforms the existing methods by reducing 27% to 42% in terms of the maximum error for dynamic network reconstruction when fixing the number of restarts. Our method reduces the number of restarts by 25% to 50% when fixing the maximum error tolerated.

An Enhanced Incremental SVD Algorithm for Change Point Detection in Dynamic Networks

Change Point Detection for Nonparametric Regression under Strongly Mixing Process

A Novel Approach to Incremental SVM Learning Algorithm

An Edge-Centric Approach for Change Point Detection in Dynamic Networks.

An Incremental Updating Method for Support Vector Machines

An Incremental Learning Algorithm Based on Support Vector Domain Classifier

TIMERS: Error-Bounded SVD Restart on Dynamic Networks

Optimal Change Point Detection and Localization in Sparse Dynamic Networks

Change-point detection in dynamic networks via graphon estimation

Subspace Change-Point Detection: A New Model and Solution.

Process Structure Change Detection By Eigenvalue-Based Method

Change point detection in dynamic heterogeneous networks via subspace tracking

VGGM: Variational Graph Gaussian Mixture Model for Unsupervised Change Point Detection in Dynamic Networks

Yongmiao Hong, Oliver Linton, Jiajing Sun, and Meiting Zhu’s Contribution to the Discussion of ‘the Discussion Meeting on Probabilistic and Statistical Aspects of Machine Learning’

On Detection of Change Points Using Mean Vectors

Sequential Subspace Change-Point Detection

A Novel Approach for Fast Detection of Multiple Change Points in Linear Models

Latent evolution model for change point detection in time-varying networks

Online Change Points Detection for Linear Dynamical Systems with Finite Sample Guarantees

Change-Point Detection in Dynamic Networks with Missing Links

Change point detection in temporal networks based on graph snapshot similarity measures