Abstract:Low-dimension graph embeddings have proved extremely useful in various downstream tasks in large graphs, e.g., link-related content recommendation and node classification tasks, etc. Most existing embedding approaches take nodes as the basic unit for information aggregation, e.g., node perception fields in GNN or con-textual nodes in random walks. The main drawback raised by such node-view is its lack of support for expressing the compound relationships between nodes, which results in the loss of a certain degree of graph information during embedding. To this end, this paper pro-poses PairE(Pair Embedding), a solution to use "pair", a higher level unit than a "node" as the core for graph embeddings. Accordingly, a multi-self-supervised auto-encoder is designed to fulfill two pretext tasks, to reconstruct the feature distribution for respective pairs and their surrounding context. PairE has three major advantages: 1) Informative, embedding beyond node-view are capable to preserve richer information of the graph; 2) Simple, the solutions provided by PairE are time-saving, storage-efficient, and require the fewer hyper-parameters; 3) High adaptability, with the introduced translator operator to map pair embeddings to the node embeddings, PairE can be effectively used in both the link-based and the node-based graph analysis. Experiment results show that PairE consistently outperforms the state of baselines in all four downstream tasks, especially with significant edges in the link-prediction and multi-label node classification tasks.

Embedding Words in Non-Vector Space with Unsupervised Graph Learning

Embedding Graphs on Grassmann Manifold

Pair-view Unsupervised Graph Representation Learning

Unsupervised Graph Embedding via Adaptive Graph Learning

Making Fast Graph-based Algorithms with Graph Metric Embeddings

Unsupervised Inductive Graph-Level Representation Learning Via Graph-Graph Proximity

Unsupervised Inductive Whole-Graph Embedding by Preserving Graph Proximity

Unsupervised Network Embedding for Graph Visualization, Clustering and Classification

Graph Representation Learning Beyond Node and Homophily

Deep Gaussian Embedding of Graphs: Unsupervised Inductive Learning via Ranking

Out-of-Vocabulary Embedding Imputation with Grounded Language Information by Graph Convolutional Networks

Weighted Embeddings for Low-Dimensional Graph Representation

On Embedding Implementations in Text Ranking and Classification Employing Graphs

Learning representations for gene ontology terms by jointly encoding graph structure and textual node descriptors

Learning Structural Genetic Information via Graph Neural Embedding

Neural Embeddings of Graphs in Hyperbolic Space

GLoMo: Unsupervised Learning of Transferable Relational Graphs

Word-Graph2vec: An efficient word embedding approach on word co-occurrence graph using random walk technique

Graph Vertex Embeddings: Distance, Regularization and Community Detection

GraphWGAN: Graph Representation Learning with Wasserstein Generative Adversarial Networks