Abstract:Heterogeneous graphs (HGs) contain many nodes and their interaction relationships, which can model complex systems and provide rich semantic and structural information for task execution. Among these, HG representation stands as the fundamental and pivotal component. Existing HG representation methods primarily employ graph neural networks to acquire the semantics of nodes along various meta-paths and fuse them to represent the nodes. The most prevalent HG representation methods encompass two steps: semantic information extraction within meta-paths and semantic fusion between meta-paths. However, these methods overlooked the consideration of node heterogeneity within meta-paths and the simultaneous semantic correlation between meta-paths. Specifically, node heterogeneity within meta-paths signifies that the meta-path-based neighbors do not consistently contain information that positively influences the target node, and the semantic correlation between meta-paths indicates that different meta-path spaces are not entirely independent. Disregarding either of these issues leads to the propagation of irrelevant or redundant information and potential disruption of HG embedding. Consequently, in this study, we propose the HBHG, which is a hierarchical bottleneck for heterogeneous graph representation. HBHG primarily employs the information bottleneck (IB) as a guiding principle, constraining the propagation of irrelevant information within and between meta-paths while preserving relevant information. The central concept of the IB revolves around viewing model learning as the preservation of relevant information and compression of irrelevant information, accomplished by minimizing the dependency between input and hidden features through mutual information (MI) and maximizing the dependency between hidden features and ground-truth. Considering the complexity associated with MI estimation, this paper introduces a novel dependency index, namely the Hilbert-Schmidt independence criterion (HSIC), which offers ease of calculation. Specifically, HBHG comprises two primary components: a semantic bottleneck within meta-paths and a semantic bottleneck between meta-paths. The semantic bottleneck within meta-paths relies primarily on the HSIC-based limitations of dependencies at different layers of the graph neural network on various meta-paths, thereby maximizing the extraction of information relevant to the target node from neighboring nodes. The semantic bottleneck between meta-paths enables flexible extraction and fusion of semantic information based on downstream tasks, achieved by managing the trade-off of dependencies with HSIC between different meta-path semantic spaces. In summary, the proposed HBHG integrates hierarchical bottleneck constraints within and between meta-paths. This integration serves to maximize the aggregation of relevant information while effectively compressing irrelevant information, thereby enhancing the quality of heterogeneous graph embedding. The effectiveness of HBHG was validated through performance and ablation experiments conducted on multiple datasets.

Latent neighborhood-based heterogeneous graph representation

Deep Generation of Heterogeneous Networks

Meta-path-based heterogeneous graph neural networks in academic network

When Heterophily Meets Heterogeneous Graphs: Latent Graphs Guided Unsupervised Representation Learning

DiffMG: Differentiable Meta Graph Search for Heterogeneous Graph Neural Networks

Meta-Path-Free Representation Learning on Heterogeneous Networks

HGBER: Heterogeneous Graph Neural Network With Bidirectional Encoding Representation

Heterogeneous Graph Propagation Network

Heterogeneous Deep Graph Infomax

Hetero$^2$Net: Heterophily-aware Representation Learning on Heterogenerous Graphs

Metapaths guided Neighbors aggregated Network for?Heterogeneous Graph Reasoning

HGAMLP: Heterogeneous Graph Attention MLP with De-Redundancy Mechanism

MHNF: Multi-hop Heterogeneous Neighborhood information Fusion graph representation learning

Hierarchical Bottleneck for Heterogeneous Graph Representation

Heterogeneous hypergraph representation learning for link prediction

GraphHINGE: Learning Interaction Models of Structured Neighborhood on Heterogeneous Information Network

Heterogeneous Graph Knowledge Distillation Neural Network Incorporating Multiple Relations and Cross-Semantic Interactions

Heterogeneous Graph Transformer for Meta-structure Learning with Application in Text Classification

Heterogeneous Graph Neural Network With Multi-View Representation Learning

Explicit Message-Passing Heterogeneous Graph Neural Network

HGNN−BRFE: Heterogeneous Graph Neural Network Model Based on Region Feature Extraction