Abstract:Content representation is a fundamental task in information retrieval. Representation learning is aimed at capturing features of an information object in a low-dimensional space. Most research on representation learning for heterogeneous information networks (HINs) focuses on static HINs. In practice, however, networks are dynamic and subject to constant change. In this article, we propose a novel and scalable representation learning model, M-DHIN , to explore the evolution of a dynamic HIN. We regard a dynamic HIN as a series of snapshots with different time stamps. We first use a static embedding method to learn the initial embeddings of a dynamic HIN at the first time stamp. We describe the features of the initial HIN via metagraphs, which retains more structural and semantic information than traditional path-oriented static models. We also adopt a complex embedding scheme to better distinguish between symmetric and asymmetric metagraphs. Unlike traditional models that process an entire network at each time stamp, we build a so-called change dataset that only includes nodes involved in a triadic closure or opening process, as well as newly added or deleted nodes. Then, we utilize the above metagraph-based mechanism to train on the change dataset. As a result of this setup, M-DHIN is scalable to large dynamic HINs since it only needs to model the entire HIN once while only the changed parts need to be processed over time. Existing dynamic embedding models only express the existing snapshots and cannot predict the future network structure. To equip M-DHIN with this ability, we introduce an LSTM-based deep autoencoder model that processes the evolution of the graph via an LSTM encoder and outputs the predicted graph. Finally, we evaluate the proposed model, M-DHIN , on real-life datasets and demonstrate that it significantly and consistently outperforms state-of-the-art models.

Representation Learning in Heterogeneous Information Networks Based on Hyper Adjacency Matrix

Deep Learning-based Heterogeneous Information Network Representation:A Survey

Heterogeneous Network Representation Learning Based on Adaptive Multi-channel Graph Convolution

Meta-Path-Free Representation Learning on Heterogeneous Networks

RL4HIN: Representation Learning for Heterogeneous Information Networks.

Generative Adversarial Network and Meta-path Based Heterogeneous Network Representation Learning

AttrHIN: Network Representation Learning Method for Heterogeneous Information Network

Heterogeneous Deep Graph Infomax

HINormer: Representation Learning on Heterogeneous Information Networks with Graph Transformer.

Self-supervised Nodes-Hyperedges Embedding for Heterogeneous Information Network Learning

Scalable Representation Learning for Dynamic Heterogeneous Information Networks via Metagraphs

Pre-Trained Models for Heterogeneous Information Networks

Adversarial Learning on Heterogeneous Information Networks

Gahne: Graph-Aggregated Heterogeneous Network Embedding

HINChip: Heterogeneous Information Network Representation with Community Hierarchy Preserving

Local Structural Aware Heterogeneous Information Network Embedding Based on Relational Self-Attention Graph Neural Network

TransPath: Representation Learning for Heterogeneous Information Networks Via Translation Mechanism

Heterogeneous Hypernetwork Representation Learning with Hyperedge Fusion

<inline-formula><tex-math notation="LaTeX">$\mathsf{PF\text{-}HIN}$</tex-math></inline-formula>:Pre-Training for Heterogeneous Information Networks

HAHE: Hierarchical Attentive Heterogeneous Information Network Embedding.

An Efficient Multi-View Heterogeneous Hypergraph Convolutional Network for Heterogeneous Information Network Representation Learning