Abstract:Graph neural networks (GNNs) have been widely used in deep learning on graphs. They can learn effective node representations that achieve superior performances in graph analysis tasks such as node classification and node clustering. However, most methods ignore the heterogeneity in real-world graphs. Methods designed for heterogeneous graphs, on the other hand, fail to learn complex semantic representations because they only use meta-paths instead of meta-graphs. Furthermore, they cannot fully capture the content-based correlations between nodes, as they either do not use the self-attention mechanism or only use it to consider the immediate neighbors of each node, ignoring the higher-order neighbors. We propose a novel Higher-order Attribute-Enhancing (HAE) framework that enhances node embedding in a layer-by-layer manner. Under the HAE framework, we propose a Higher-order Attribute-Enhancing Graph Neural Network (HAE(GNN)) for heterogeneous network representation learning. HAE(GNN) simultaneously incorporates meta-paths and meta-graphs for rich, heterogeneous semantics, and leverages the self-attention mechanism to explore content-based nodes' interactions. The unique higher-order architecture of HAE(GNN) allows examining the first-order as well as higher-order neighborhoods. Moreover, HAE(GNN) shows good explainability as it learns the importances of different meta-paths and meta-graphs. HAE(GNN) is also memory-efficient, for it avoids per meta-path based matrix calculation. Experimental results not only show HAE(GNN)'s superior performance against the state-of-the-art methods in node classification, node clustering, and visualization, but also demonstrate its superiorities in terms of memory efficiency and explainability.

Position Encoding for Heterogeneous Graph Neural Networks

PHGNN: Position-aware Graph Neural Network for Heterogeneous Graph Embedding.

HGBER: Heterogeneous Graph Neural Network With Bidirectional Encoding Representation

Graph Neural Networks with Learnable Structural and Positional Representations

Heterogeneous Graph Neural Network with Distance Encoding.

Heterogeneous Graph Neural Network With Multi-View Representation Learning

Heterogeneous Graph Neural Networks with Denoising for Graph Embeddings

What Are Good Positional Encodings for Directed Graphs?

Heterogeneous Graph Embedding by Aggregating Meta-Path and Meta-Structure Through Attention Mechanism

DiffMG: Differentiable Meta Graph Search for Heterogeneous Graph Neural Networks

Heterogeneous Graphlets-Guided Network Embedding Via Eulerian-Trail-based Representation

Generalizing Message Passing Neural Networks to Heterophily Using Position Information

Higher-Order Attribute-Enhancing Heterogeneous Graph Neural Networks

Heterogeneous Graph Embedding Based on Edge-aware Neighborhood Convolution

Megnn: Meta-path extracted graph neural network for heterogeneous graph representation learning

Heterogeneous Graph Propagation Network

HGATE: Heterogeneous Graph Attention Auto-Encoders

Distance Information Improves Heterogeneous Graph Neural Networks

HeMGNN: Heterogeneous Network Embedding Based on a Mixed Graph Neural Network

Heterogeneous Graph Neural Networks Based on Meta-path

Seq-HGNN: Learning Sequential Node Representation on Heterogeneous Graph