Abstract:Dynamic network representation learning has recently attracted increasing attention because real-world networks evolve over time, that is nodes and edges join or leave the networks over time. Different from static networks, the representation learning of dynamic networks should not only consider how to capture the structural information of network snapshots, but also consider how to capture the temporal dynamic information of network structure evolution from the network snapshot sequence. From the existing work on dynamic network representation, there are two main problems: (1) A significant number of methods target dynamic networks, which only allow nodes to increase over time, not decrease, which reduces the applicability of such methods to real-world networks. (2) At present, most network-embedding methods, especially dynamic network representation learning approaches, use Euclidean embedding space. However, the network itself is geometrically non-Euclidean, which leads to geometric inconsistencies between the embedded space and the underlying space of the network, which can affect the performance of the model. In order to solve the above two problems, we propose a geometry-based dynamic network learning framework, namely DyLFG. Our proposed framework targets dynamic networks, which allow nodes and edges to join or exit the network over time. In order to extract the structural information of network snapshots, we designed a new hyperbolic geometry processing layer, which is different from the previous literature. In order to deal with the temporal dynamics of the network snapshot sequence, we propose a gated recurrent unit (GRU) module based on Ricci curvature, that is the RGRU. In the proposed framework, we used a temporal attention layer and the RGRU to evolve the neural network weight matrix to capture temporal dynamics in the network snapshot sequence. The experimental results showed that our model outperformed the baseline approaches on the baseline datasets.

Disentangle-based Continual Graph Representation Learning

Disentangled Generative Graph Representation Learning

Continual Graph Learning: A Survey

E-CGL: An Efficient Continual Graph Learner

HSDN: A High-Order Structural Semantic Disentangled Neural Network

RelaGraph: Improving Embedding on Small-Scale Sparse Knowledge Graphs by Neighborhood Relations

DyLFG: A Dynamic Network Learning Framework Based on Geometry

DisenE: Disentangling Knowledge Graph Embeddings

Disentangled Graph Convolutional Networks

A comprehensive survey on deep graph representation learning

Sufficient Subgraph Embedding Memory for Continual Graph Representation Learning

Learning dual disentangled representation with self-supervision for temporal knowledge graph reasoning

Continual Learning on Graphs: Challenges, Solutions, and Opportunities

Expressivity of Representation Learning on Continuous-Time Dynamic Graphs: An Information-Flow Centric Review

Feature-Dependent Graph Convolutional Autoencoders with Adversarial Training Methods

Ricci Curvature-Based Graph Sparsification for Continual Graph Representation Learning.

Attentive Graph Enhanced Region Representation Learning

Federated Continual Graph Learning

Exploring Data Geometry for Continual Learning

A Dilated Recurrent Neural Network-Based Model for Graph Embedding

SMGRL: Scalable Multi-resolution Graph Representation Learning