Abstract:Network representation learning, as an approach to learn low dimensional representations of vertices, has attracted considerable research attention recently. It has been proven extremely useful in many machine learning tasks over large graph. Most existing methods focus on learning the structural representations of vertices in a static network, but cannot guarantee an accurate and efficient embedding in a dynamic network scenario. The fundamental problem of continuously capturing the dynamic properties in an efficient way for a dynamic network remains unsolved. To address this issue, we present an efficient incremental skip-gram algorithm with negative sampling for dynamic network embedding, and provide a set of theoretical analyses to characterize the performance guarantee. Specifically, we first partition a dynamic network into the updated, including addition/deletion of links and vertices, and the retained networks over time. Then we factorize the objective function of network embedding into the added, vanished and retained parts of the network. Next we provide a new stochastic gradient-based method, guided by the partitions of the network, to update the nodes and the parameter vectors. The proposed algorithm is proven to yield an objective function value with a bounded difference to that of the original objective function. The first order moment of the objective difference converges in order of $$\mathbb{O}(\frac{1}{n^{2}})$$ , and the second order moment of the objective difference can be stabilized in order of $$\mathbb{O}(1)$$ . Experimental results show that our proposal can significantly reduce the training time while preserving the comparable performance. We also demonstrate the correctness of the theoretical analysis and the practical usefulness of the dynamic network embedding. We perform extensive experiments on multiple real-world large network datasets over multi-label classification and link prediction tasks to evaluate the effectiveness and efficiency of the proposed framework, and up to 22 times speedup has been achieved.

Network embedding based on high-degree penalty and adaptive negative sampling

Leveraging Network Structure for Efficient Dynamic Negative Sampling in Network Embedding

An Adaptive Node Embedding Framework for Multiplex Networks

Dynamic Network Embedding Via Incremental Skip-Gram with Negative Sampling

Adversarial Training Regularization for Negative Sampling Based Network Embedding

Network Embedding Method Based on Extractive Summary.

DNPS:Damping Based Negative-Positive Sampling of Large-Scale Dynamic Social Network Embedding

Efficient Link Prediction via GNN Layers Induced by Negative Sampling

SCE: Scalable Network Embedding from Sparsest Cut

Universal Knowledge Graph Embedding Framework Based on High-Quality Negative Sampling and Weighting

Deep Kernel Network Embedding

An Adaptive Cross-Layer Sampling-Based Node Embedding for Multiplex Networks

HNS: Hierarchical Negative Sampling for Network Representation Learning

Network Embedding Using Semi-Supervised Kernel Nonnegative Matrix Factorization

Enhancing the Network Embedding Quality with Structural Similarity

NEGAN: Network Embedding Based on Generative Adversarial Networks

Learning Large-scale Network Embedding from Representative Subgraph

Knowledge Graph Embedding Based on Adaptive Negative Sampling.

Auditing Network Embedding: an Edge Influence Based Approach

Free Energy Node Embedding via Generalized Skip-gram with Negative Sampling

Depthlgp: Learning Embeddings Of Out-Of-Sample Nodes In Dynamic Networks