Abstract:Graphs have become widely adopted as a means of representing relationships between entities in many applications. These graphs often evolve over time. Learning effective representations preserving graph topology, as well as latent patterns in temporal dynamics, has drawn increasing interests. In this paper, we investigate the problem of dynamic graph embedding that maps a time series of graphs to a low dimensional feature space. However, most existing works in the field of dynamic representation learning either consider temporal evolution of low-order proximity or treat high-order proximity and temporal dynamics separately. It is challenging to learn one single embedding that can preserve the high-order proximity with long-term temporal dependencies. We propose a Generative Adversarial Networks (GAN) based model, named DynGraphGAN, to learn robust feature representations. It consists of a generator and a discriminator trained in an adversarial process. The generator generates connections between nodes that are represented by a series of adjacency matrices. The discriminator integrates a graph convolutional network for high-order proximity and a convolutional neural network for temporal dependency to distinguish real samples from fake samples produced by the generator. With iterative boosting of the performance of the generator and discriminator, node embeddings are learned to present dynamic evolution over time. By jointly considering high-order proximity and temporal evolution, our model can preserve spatial structure with temporal dependency. DynGraphGAN is optimized on subgraphs produced by random walks to capture more complex structural and temporal patterns in the dynamic graphs. We also leverage sparsity and temporal smoothness properties to further improve the model efficiency. Our model demonstrates substantial gains over several baseline models in link prediction and reconstruction tasks on real-world datasets.

Deep Neural Networks for Learning Graph Representations

Deep Neural Networks for Learning Graph Representations

Graph Learning in Low Dimensional Space for Graph Convolutional Networks

Deep Learning for Learning Graph Representations

Learning Deep Graph Representations via Convolutional Neural Networks

Representation Learning on Graphs: Methods and Applications

Learning graph-level representation from local-structural distribution with Graph Neural Networks

A comprehensive survey on deep graph representation learning

Learning the Implicit Semantic Representation on Graph-Structured Data

Deep Loopy Neural Network Model for Graph Structured Data Representation Learning

Deep Feature Learning for Graphs

Deep Gaussian Embedding of Graphs: Unsupervised Inductive Learning via Ranking

A deep latent space model for interpretable representation learning on directed graphs

GraphGAN: Graph Representation Learning with Generative Adversarial Nets

A Comprehensive Survey on Deep Graph Representation Learning Methods

Dyngraphgan: Dynamic Graph Embedding Via Generative Adversarial Networks

Unsupervised Inductive Graph-Level Representation Learning Via Graph-Graph Proximity

Learning Deep Representations for Graph Clustering

Learning Graph-Level Representations with Recurrent Neural Networks

Deep Learning on Attributed Graphs: A Journey from Graphs to Their Embeddings and Back

Representation learning of in-degree-based digraph with rich information