Abstract:Content representation is a fundamental task in information retrieval. Representation learning is aimed at capturing features of an information object in a low-dimensional space. Most research on representation learning for heterogeneous information networks (HINs) focuses on static HINs. In practice, however, networks are dynamic and subject to constant change. In this article, we propose a novel and scalable representation learning model, M-DHIN , to explore the evolution of a dynamic HIN. We regard a dynamic HIN as a series of snapshots with different time stamps. We first use a static embedding method to learn the initial embeddings of a dynamic HIN at the first time stamp. We describe the features of the initial HIN via metagraphs, which retains more structural and semantic information than traditional path-oriented static models. We also adopt a complex embedding scheme to better distinguish between symmetric and asymmetric metagraphs. Unlike traditional models that process an entire network at each time stamp, we build a so-called change dataset that only includes nodes involved in a triadic closure or opening process, as well as newly added or deleted nodes. Then, we utilize the above metagraph-based mechanism to train on the change dataset. As a result of this setup, M-DHIN is scalable to large dynamic HINs since it only needs to model the entire HIN once while only the changed parts need to be processed over time. Existing dynamic embedding models only express the existing snapshots and cannot predict the future network structure. To equip M-DHIN with this ability, we introduce an LSTM-based deep autoencoder model that processes the evolution of the graph via an LSTM encoder and outputs the predicted graph. Finally, we evaluate the proposed model, M-DHIN , on real-life datasets and demonstrate that it significantly and consistently outperforms state-of-the-art models.

Metapath Enhanced Graph Attention Encoder For Hins Representation Learning

Heterogeneous Information Network Embedding with Meta-path Based Graph Attention Networks.

Scalable Representation Learning for Dynamic Heterogeneous Information Networks via Metagraphs

MECCH: Metapath Context Convolution-based Heterogeneous Graph Neural Networks

Heterogeneous Deep Graph Infomax

Meta-path-based heterogeneous graph neural networks in academic network

Meta-HGT: Metapath-aware HyperGraph Transformer for heterogeneous information network embedding

Heterogeneous Information Network Representation Learning Framework Based on Graph Attention Network

HGBER: Heterogeneous Graph Neural Network With Bidirectional Encoding Representation

Megnn: Meta-path extracted graph neural network for heterogeneous graph representation learning

Metapaths guided Neighbors aggregated Network for?Heterogeneous Graph Reasoning

HINormer: Representation Learning on Heterogeneous Information Networks with Graph Transformer.

Representation Learning in Heterogeneous Information Networks Based on Hyper Adjacency Matrix

MMAN: Metapath Based Multi-Level Graph Attention Networks for Heterogeneous Network Embedding (Student Abstract)

MIED : an Improved Graph Neural Network for Node Embedding in Heterogeneous Graphs.

HAHE: Hierarchical Attentive Heterogeneous Information Network Embedding.

MHNF: Multi-hop Heterogeneous Neighborhood information Fusion graph representation learning

Embedding Representation of Academic Heterogeneous Information Networks Based on Federated Learning

DiffMG: Differentiable Meta Graph Search for Heterogeneous Graph Neural Networks

Heterogeneous Information Network Embedding with Convolutional Graph Attention Networks.

Learning Multiplex Representations on Text-Attributed Graphs with One Language Model Encoder