Abstract:Network embedding has numerous practical applications and has received extensive attention in graph learning, which aims at mapping vertices into a low-dimensional and continuous dense vector space by preserving the underlying structural properties of the graph. Many network embedding methods have been proposed, among which factorization of the Personalized PageRank (PPR for short) matrix has been empirically and theoretically well supported recently. However, several fundamental issues cannot be addressed. (1) Existing methods invoke a seminal Local Push subroutine to approximate \textit{a single} row or column of the PPR matrix. Thus, they have to execute $n$ ($n$ is the number of nodes) Local Push subroutines to obtain a provable PPR matrix, resulting in prohibitively high computational costs for large $n$. (2) The PPR matrix has limited power in capturing the structural similarity between vertices, leading to performance degradation. To overcome these dilemmas, we propose PSNE, an efficient spectral s\textbf{P}arsification method for \textbf{S}caling \textbf{N}etwork \textbf{E}mbedding, which can fast obtain the embedding vectors that retain strong structural similarities. Specifically, PSNE first designs a matrix polynomial sparser to accelerate the calculation of the PPR matrix, which has a theoretical guarantee in terms of the Frobenius norm. Subsequently, PSNE proposes a simple but effective multiple-perspective strategy to enhance further the representation power of the obtained approximate PPR matrix. Finally, PSNE applies a randomized singular value decomposition algorithm on the sparse and multiple-perspective PPR matrix to get the target embedding vectors. Experimental evaluation of real-world and synthetic datasets shows that our solutions are indeed more efficient, effective, and scalable compared with ten competitors.

Diverse Power Iteration Embeddings and Its Applications

Diverse Power Iteration Embeddings: Theory and Practice

Learning spectral embedding via iterative eigenvalue thresholding.

Energy-efficient Pipelined DTW Architecture on Hybrid Embedded Platforms

Accelerated Algorithms for Eigen-Value Decomposition with Application to Spectral Clustering

Fast Optimization of Spectral Embedding and Improved Spectral Rotation

Hybrid Hierarchical Clustering - Piecewise Aggregate Approximation, with Applications

Practical and Fast Momentum-Based Power Methods

Online Learning over Distributed Low-Rank Networks Via Sequential Power Iteration

Spectral clustering with linear embedding: A discrete clustering method for large-scale data

Spectral clustering based on iterative optimization for large-scale and high-dimensional data.

Semi-supervised Power Iteration Clustering

Mim: A Merge Iteration And Its Applications For Big Data

Large Graph Clustering with Simultaneous Spectral Embedding and Discretization

Discrete Spectral Hashing for Efficient Similarity Retrieval.

PSNE: Efficient Spectral Sparsification Algorithms for Scaling Network Embedding

HyperEmbed: Tradeoffs Between Resources and Performance in NLP Tasks with Hyperdimensional Computing enabled Embedding of n-gram Statistics

E-Embed: A time series visualization framework based on earth mover's distance.

Deep Spectral Clustering via Joint Spectral Embedding and Kmeans

Learning the Distribution of Data for Embedding

Improving Pairwise PEE Via Hybrid-Dimensional Histogram Generation and Adaptive Mapping Selection