Abstract:Network embedding has numerous practical applications and has received extensive attention in graph learning, which aims at mapping vertices into a low-dimensional and continuous dense vector space by preserving the underlying structural properties of the graph. Many network embedding methods have been proposed, among which factorization of the Personalized PageRank (PPR for short) matrix has been empirically and theoretically well supported recently. However, several fundamental issues cannot be addressed. (1) Existing methods invoke a seminal Local Push subroutine to approximate \textit{a single} row or column of the PPR matrix. Thus, they have to execute $n$ ($n$ is the number of nodes) Local Push subroutines to obtain a provable PPR matrix, resulting in prohibitively high computational costs for large $n$. (2) The PPR matrix has limited power in capturing the structural similarity between vertices, leading to performance degradation. To overcome these dilemmas, we propose PSNE, an efficient spectral s\textbf{P}arsification method for \textbf{S}caling \textbf{N}etwork \textbf{E}mbedding, which can fast obtain the embedding vectors that retain strong structural similarities. Specifically, PSNE first designs a matrix polynomial sparser to accelerate the calculation of the PPR matrix, which has a theoretical guarantee in terms of the Frobenius norm. Subsequently, PSNE proposes a simple but effective multiple-perspective strategy to enhance further the representation power of the obtained approximate PPR matrix. Finally, PSNE applies a randomized singular value decomposition algorithm on the sparse and multiple-perspective PPR matrix to get the target embedding vectors. Experimental evaluation of real-world and synthetic datasets shows that our solutions are indeed more efficient, effective, and scalable compared with ten competitors.

A Unified Approach to Scalable Spectral Sparsification of Directed Graphs

diGRASS: Di rected Gra ph S pectral S parsification via Spectrum-Preserving Symmetrization

Spectrum-preserving Sparsification for Visualization of Big Graphs

An Efficient Algorithm for Unweighted Spectral Graph Sparsification

Heterogeneous Graph Sparsification for Efficient Representation Learning

Similarity-Aware Spectral Sparsification by Edge Filtering

On Spectral Analysis of Directed Signed Graphs

PSNE: Efficient Spectral Sparsification Algorithms for Scaling Network Embedding

Linear-Sized Spectral Sparsifiers and the Kadison-Singer Problem

Spectral Inference Methods on Sparse Graphs: Theory and Applications

Eulerian Graph Sparsification by Effective Resistance Decomposition

Spectral embedding of directed networks

Demystifying Graph Sparsification Algorithms in Graph Properties Preservation

inGRASS: Incremental Graph Spectral Sparsification via Low-Resistance-Diameter Decomposition

GRASPEL: Graph Spectral Learning at Scale

Singular Value Approximation and Sparsifying Random Walks on Directed Graphs

Incremental Spectral Sparsification for Large-Scale Graph-Based Semi-Supervised Learning

Scalable Graph Embeddings Via Sparse Transpose Proximities

Efficient Spectral Graph Sparsification Via Krylov-Subspace Based Spectral Perturbation Analysis

Large Graph Clustering with Simultaneous Spectral Embedding and Discretization

Spectral Graph Analysis: A Unified Explanation and Modern Perspectives