Abstract:Graph Neural Networks (GNNs) have received considerable attention in recent years due to their unique ability to model both topologies and semantics in the graphs. In this paper, we explore the use of GNNs in learning low-dimensional node representations in Heterogeneous Information Networks (HINs), which retain rich semantic information across multiple types of nodes and relations. Existing methods for HINs generally focus on modeling heterogeneity at either the node level or the relation level, but not both. As a result, these methods often fall short of optimal performance. To address this issue, we propose a novel Semantic- and Relation-aware Heterogeneous Graph neural Network, dubbed SR-HGN, which jointly incorporates rich semantics preserved on nodes and relations. Our approach involves projecting the HINs into a low-dimensional vector space through two steps: node-level aggregation and type-level aggregation. The node-level aggregation employs an attention mechanism to create relation vectors by aggregating messages from neighborhoods connected via the same type of relation. The type-level aggregation leverages relation vectors to aggregate node representations. In particular, we introduce semantic-aware attention and relation-aware attention in the type-level aggregation to model the contributions of relation vectors, in order to simultaneously gain knowledge from node semantics and relational information. Unlike other approaches that rely on pre-defined meta-paths, our model can be readily applied to most real-world applications without requiring any domain knowledge. To validate the effectiveness of our proposed approach, we conducted extensive experiments on three public datasets. Experimental results demonstrate that the SR-HGN significantly outperforms state-of-the-art baselines on node classification and node clustering tasks.

Text-Rich Graph Neural Networks with Subjective-Objective Semantic Modeling

Embedding Text-Rich Graph Neural Networks with Sequence and Topical Semantic Structures

AS-GCN: Adaptive Semantic Architecture of Graph Convolutional Networks for Text-Rich Networks

Signed Attention Based Graph Neural Network for Graphs with Heterophily.

Efficient and effective training of language and graph neural network models

Graph Neural Networks with Soft Association Between Topology and Attribute

Modeling Heterogeneity with Flexible and Semantic Aligned Graph Neural Networks

Semantic-guided graph neural network for heterogeneous graph embedding

Status-Aware Signed Heterogeneous Network Embedding With Graph Neural Networks

The Expressive Power of Graph Neural Networks: A Survey

Multi-grained Semantics-aware Graph Neural Networks

Beyond Homophily in Graph Neural Networks: Current Limitations and Effective Designs

SR-HGN: Semantic- and Relation-Aware Heterogeneous Graph Neural Network

Seeking Similarities While Removing Differences: Graph Neural Networks Based on Node Correlation.

When Do Graph Neural Networks Help with Node Classification? Investigating the Impact of Homophily Principle on Node Distinguishability

Can LLMs Convert Graphs to Text-Attributed Graphs?

Meta-Weight Graph Neural Network: Push the Limits Beyond Global Homophily

TeKo: Text-Rich Graph Neural Networks with External Knowledge

Graph Learning in the Era of LLMs: A Survey from the Perspective of Data, Models, and Tasks

Similarity-navigated Graph Neural Networks for Node Classification

A Multi-Granularity Heterogeneous Graph for Extractive Text Summarization