Abstract:Heterogeneous information network (HIN) has been applied in a wide variety of graph analysis tasks. At present, it is a trend of heterogeneous graph neural networks (HGNNs) to cast the meta-paths aside, since it solves the problem of structural information loss caused by artificially designed meta-paths. However, existing meta-path-free HGNNs fail to take into account that most node types in many HINs have no attributes, and they cannot make full use of sparse node attributes when applied to HINs with missing attributes. Furthermore, their computation of attention coefficients explores the correlations of node attributes while almost ignoring structural ones, which may limit the expression ability of the model and cause overfitting in model training. To alleviate these issues, we propose an HGNN with attribute enhancement and structure-aware attention (HGNN-AESA). First, we design an attribute enhancement module (AEM) to connect more useful attributed nodes to the target nodes. Specifically, AEM introduces a random walk with restart (RWR) strategy to obtain structural relevance scores of each node within its specific subgraph. The structural relevance scores are used to capture potentially influential attributed nodes in high-order neighborhood for each target node. Second, we propose heterogeneous structure-aware attention layers (HSALs) to learn node representations. HSALs follow a hierarchical attention framework, including node-level and type-level attention. The node-level attention aggregates feature (attribute) embeddings of same-type neighbors, and the relevant attention coefficients depend on the combination of node attributes and heterogeneous structural interventions. The type-level attention fuses all type-specific vector representations and generates the ultimate node embedding. Finally, extensive experiments on three different real-world HIN datasets demonstrate that our model outperforms state-of-the-art methods.

Heterogeneous-attributes Enhancement Deep Framework for Network Embedding

Flexible Attributed Network Embedding.

DDHH: A Decentralized Deep Learning Framework for Large-scale Heterogeneous Networks

Fast Attributed Multiplex Heterogeneous Network Embedding.

Deep Attributed Network Embedding by Preserving Structure and Attribute Information

A General Embedding Framework for Heterogeneous Information Learning in Large-Scale Networks

Attributed Multi-layer Network Embedding.

Multimodal Deep Network Embedding with Integrated Structure and Attribute Information.

HSDN: A High-Order Structural Semantic Disentangled Neural Network

Structural Role Enhanced Attributed Network Embedding.

Dynamic Heterogeneous Attributed Network Embedding

Structure, Attribute And Homophily Preserved Social Network Embedding

Multi-view Dynamic Heterogeneous Information Network Embedding

Heterogeneous Attributed Network Embedding with Graph Convolutional Networks

Representation Learning for Attributed Multiplex Heterogeneous Network

Fusing heterogeneous information for multi-modal attributed network embedding

A Heterogeneous Graph Neural Network with Attribute Enhancement and Structure-Aware Attention

Attribute Disturbance for Attributed Multiplex Heterogeneous Network Embedding

A Scalable Attribute-Aware Network Embedding System

Higher-Order Attribute-Enhancing Heterogeneous Graph Neural Networks

HAHE: Hierarchical Attentive Heterogeneous Information Network Embedding.