Abstract:Attributed network embedding aims to learn low-dimensional vector representations for nodes in a network, where each node contains rich attributes/features describing node content. Because network topology structure and node attributes often exhibit high correlation, incorporating node attribute proximity into network embedding is beneficial for learning good vector representations. In reality, large-scale networks often have incomplete/missing node content or linkages, yet existing attributed network embedding algorithms all operate under the assumption that networks are complete. Thus, their performance is vulnerable to missing data and suffers from poor scalability. In this paper, we propose a Scalable Incomplete Network Embedding (SINE) algorithm for learning node representations from incomplete graphs. SINE formulates a probabilistic learning framework that separately models pairs of node-context and node-attribute relationships. Different from existing attributed network embedding algorithms, SINE provides greater flexibility to make the best of useful information and mitigate negative effects of missing information on representation learning. A stochastic gradient descent based online algorithm is derived to learn node representations, allowing SINE to scale up to large-scale networks with high learning efficiency. We evaluate the effectiveness and efficiency of SINE through extensive experiments on real-world networks. Experimental results confirm that SINE outperforms state-of-the-art baselines in various tasks, including node classification, node clustering, and link prediction, under settings with missing links and node attributes. SINE is also shown to be scalable and efficient on large-scale networks with millions of nodes/edges and high-dimensional node features. The source code of this paper is available at https://github.com/daokunzhang/SINE.

SAGES: Scalable Attributed Graph Embedding with Sampling for Unsupervised Learning

Unsupervised Graph Embedding via Adaptive Graph Learning

Scalable and Adaptive Spectral Embedding for Attributed Graph Clustering

Learning Graph Embedding with Limited Labeled Data: An Efficient Sampling Approach

SINE: Scalable Incomplete Network Embedding

Adaptive Graph Encoder for Attributed Graph Embedding

Hierarchical Estimation for Effective and Efficient Sampling Graph Neural Network

A learnable sampling method for scalable graph neural networks

Adversarial variational autoencoder for attributed graph embedding with high-frequency noise filtering

SCE: Scalable Network Embedding from Sparsest Cut

Graph Convolutional Auto-encoder with Bi-decoder and Adaptive-sharing Adjacency

SaGess: Sampling Graph Denoising Diffusion Model for Scalable Graph Generation

GraphSAINT: Graph Sampling Based Inductive Learning Method

Graph convolutional autoencoders with co-learning of graph structure and node attributes

Redundancy Is Not What You Need: An Embedding Fusion Graph Auto-Encoder for Self-Supervised Graph Representation Learning

Sampling Content Distributed Over Graphs

Understanding Graph Sampling Algorithms for Social Network Analysis

Graph Autoencoder with Preserving Node Attribute Similarity

HyperSAGE: Generalizing Inductive Representation Learning on Hypergraphs

Scalable attribute-aware network embedding with locality