Basic molecular biology.

A. Senft,A. Levine

DOI: https://doi.org/10.1016/J.PRRV.2005.06.006

IF: 5.526

2005-09-01

Paediatric Respiratory Reviews

Abstract:

What problem does this paper attempt to address?

NGAT: Attention in Breadth and Depth Exploration for Semi-Supervised Graph Representation Learning

Hu Jianke,Zhang Yin

DOI: https://doi.org/10.1631/fitee.2000657

2022-01-01

Abstract:Recently, graph neural networks (GNNs) have achieved remarkable performance in representation learning on graph-structured data. However, as the number of network layers increases, GNNs based on the neighborhood aggregation strategy deteriorate due to the problem of oversmoothing, which is the major bottleneck for applying GNNs to real-world graphs. Many efforts have been made to improve the process of feature information aggregation from directly connected nodes, i.e., breadth exploration. However, these models perform the best only in the case of three or fewer layers, and the performance drops rapidly for deep layers. To alleviate oversmoothing, we propose a nested graph attention network (NGAT), which can work in a semi-supervised manner. In addition to breadth exploration, a k-layer NGAT uses a layer-wise aggregation strategy guided by the attention mechanism to selectively leverage feature information from the kth-order neighborhood, i.e., depth exploration. Even with a 10-layer or deeper architecture, NGAT can balance the need for preserving the locality (including root node features and the local structure) and aggregating the information from a large neighborhood. In a number of experiments on standard node classification tasks, NGAT outperforms other novel models and achieves state-of-the-art performance.
A Unified Structure Learning Framework for Graph Attention Networks

Jinliang Yuan,Meng Cao,Hao Cheng,Hualei Yu,Junyuan Xie,Chongjun Wang

DOI: https://doi.org/10.1016/j.neucom.2022.01.064

IF: 6

2022-01-01

Neurocomputing

Abstract:Graph Neural Networks (GNNs) have achieved state-of-the-art performance in many fields and attracted a lot of attention in the communit. Most Graph Neural Networks can be merely used when graph-structured data is available. However, many graph structures have noise, or data itself has no graph structures, so learning the dynamic and adaptive graph structures is necessary. In this paper, we propose a unified structure learning framework for Graph Attention Networks. Specifically, we first design a strategy to learn the graph structures. Then we develop a novel attention mechanism based on structure context information of graph and node representations. Further, we devise Structure Learning Graph Attention Networks (SLGAT) and Structure Learning Attention-based Graph Neural Networks (SLAGNN) by using the new attention mechanism on the new graph. Finally, we demonstrate that our approaches outperform competing methods on six standard datasets for the semi-supervised node classification task. (c) 2022 Elsevier B.V. All rights reserved.
Heterogeneous Graph Transformer for Meta-structure Learning with Application in Text Classification

Shuhai Wang,Xin Liu,Xiao Pan,Hanjie Xu,Mingrui Liu

DOI: https://doi.org/10.1145/3580508

IF: 3.35

2023-01-30

ACM Transactions on the Web

Abstract:The prevalent heterogeneous Graph Neural Network (GNN) models learn node and graph representations using pre-defined meta-paths or only automatically discovering meta-paths. However, the existing methods suffer from information loss due to neglecting undiscovered meta-structures with richer semantics than meta-paths in heterogeneous graphs. To take advantage of the current rich meta-structures in heterogeneous graphs, we propose a novel approach called HeGTM to automatically extract essential meta-structures (i.e., meta-paths and meta-graphs) from heterogeneous graphs. The discovered meta-structures can capture more prosperous relations between different types of nodes that can help the model to learn representations. Furthermore, we apply the proposed approach for text classification. Specifically, we first design a heterogeneous graph for the text corpus, and then apply HeGTM on the constructed text graph to learn better text representations that contain various semantic relations. In addition, our approach can also be used as a strong meta-structure extractor for other GNN models. In other words, the auto-discovered meta-structures can replace the pre-defined meta-paths. The experimental results on text classification demonstrate the effectiveness of our approach to automatically extracting informative meta-structures from heterogeneous graphs and its usefulness in acting as a meta-structure extractor for boosting other GNN models.

computer science, information systems, software engineering
Meta-path-based heterogeneous graph neural networks in academic network

Xingxing Liang,Yang Ma,Guangquan Cheng,Changjun Fan,Yuling Yang,Zhong Liu

DOI: https://doi.org/10.1007/s13042-021-01465-8

2021-11-18

International Journal of Machine Learning and Cybernetics

Abstract:Heterogeneous graph representation learning is designed to learn meaningful representation vectors from heterogeneous networks in few dimensions to extract the structure and features of the attributes of these networks. The embedding vector is the basis of and crucial to complex network analysis, and can be used in such downstream tasks as classification, clustering, link prediction, and recommendation. Key issues in heterogeneous graph neural networks pertain to ways to define heterogeneous neighbors and ways to aggregate them. Although considerable research has been devoted to homogeneous and heterogeneous network representation, the effective combination of information on the network structure and the attributes of nodes, especially effective use of meta-paths containing specific semantic information, remains rare. Here a meta-path-based heterogeneous graph neural network model is proposed. The meta-path is applied to sample the heterogeneous neighbors of each node in the network, and aggregate features of the same types of nodes to form type-related embedding. A multi-head attention mechanism is then applied to aggregate information on neighbors of different types of nodes and the model is trained by reducing context loss. Experiments on classification, clustering, link prediction, and recommendation tasks verified the validity of this model, which significantly improved the results of baseline methods.

computer science, artificial intelligence
Self-supervised Graph Representations with Generative Adversarial Learning

Xuecheng Sun,Zonghui Wang,Zheming Lu,Ziqian Lu

DOI: https://doi.org/10.1016/j.neucom.2024.127786

IF: 6

2024-01-01

Neurocomputing

Abstract:Graph Neural Networks (GNNs) are powerful neural models for representation learning on graphs. In this work we study a self-supervised learning GNN method GraphSSGAN (Graph Self-Supervised Generative Adversarial Network) that learns generalized node representations using only unlabeled data. The core idea lies in learning representations that capture both the local information of the links and the global information of the plausibility of the subgraph samples. Specifically, node features of the original graph are first encoded into latent representations by optimizing a link prediction objective. Then the generator converts noise vectors to node representations in the latent space and predicts the link probabilities from the generated node representations. The discriminator leverages the graph convolutional network (GCN) architecture to produce permutation-invariant graph-level embeddings, and the intermediate node representations are used by simple classifiers in the downstream tasks. In addition, we introduce several technical tricks including Gumbel-Top-k trick, Gumbel-Softmax trick and mini-batch training via subgraph sampling to improve the training process. Through extensive experiments on node classification and link prediction tasks, we demonstrate the effectiveness of the proposed model and the contribution of GAN framework on graph representation learning.
Heterogeneous Information Network Embedding with Meta-path Based Graph Attention Networks.

Meng Cao,Xiying Ma,Ming Xu,Chongjun Wang

DOI: https://doi.org/10.1007/978-3-030-30493-5_57

2019-01-01

Abstract:Network embedding is an emerging research field which aims at projecting network elements into lower dimensional spaces. However, most network embedding algorithms focus on homogeneous networks, thus cannot be directly applied to the Heterogeneous Information Networks (HINs) which are prevalent in real world systems. Therefore, how to effectively preserve both the structural and semantic information, as well as higher-level proximity of large-scale HINs still remains an open problem. In this paper, we propose a novel heterogeneous network embedding model called Meta-path based Graph ATtention nEtwork (MetaGATE). To tackle the problem of preserving both structural and semantic information for HINs, we adopt a multiple meta-paths based random walk scheme with Skip-Gram for sampling and pre-training. In addition, the model involves graph attention networks to collect and aggregate heterogeneous information, which may reveal higher-level implicit semantics. Besides, to ensure stability, multi-head attention mechanism is employed in the graph attention model by concatenating the embedding of multiple independent self-attention processes. Experiments on two real-world bibliography networks are conducted. Compared to state-of-the-art baselines, our method achieves the best performance on the node classification task, which shows the effectiveness of the proposed model.
SHGNN: Structure-Aware Heterogeneous Graph Neural Network

Wentao Xu,Yingce Xia,Weiqing Liu,Jiang Bian,Jian Yin,Tie-Yan Liu

DOI: https://doi.org/10.48550/arXiv.2112.06244

2021-12-14

Abstract:Many real-world graphs (networks) are heterogeneous with different types of nodes and edges. Heterogeneous graph embedding, aiming at learning the low-dimensional node representations of a heterogeneous graph, is vital for various downstream applications. Many meta-path based embedding methods have been proposed to learn the semantic information of heterogeneous graphs in recent years. However, most of the existing techniques overlook the graph structure information when learning the heterogeneous graph embeddings. This paper proposes a novel Structure-Aware Heterogeneous Graph Neural Network (SHGNN) to address the above limitations. In detail, we first utilize a feature propagation module to capture the local structure information of intermediate nodes in the meta-path. Next, we use a tree-attention aggregator to incorporate the graph structure information into the aggregation module on the meta-path. Finally, we leverage a meta-path aggregator to fuse the information aggregated from different meta-paths. We conducted experiments on node classification and clustering tasks and achieved state-of-the-art results on the benchmark datasets, which shows the effectiveness of our proposed method.

Social and Information Networks,Machine Learning
MGATs: Motif-Based Graph Attention Networks

Jinfang Sheng,Yufeng Zhang,Bin Wang,Yaoxing Chang

DOI: https://doi.org/10.3390/math12020293

IF: 2.4

2024-01-17

Mathematics

Abstract:In recent years, graph convolutional neural networks (GCNs) have become a popular research topic due to their outstanding performance in various complex network data mining tasks. However, current research on graph neural networks lacks understanding of the high-order structural features of networks, focusing mostly on node features and first-order neighbor features. This article proposes two new models, MGAT and MGATv2, by introducing high-order structure motifs that frequently appear in networks and combining them with graph attention mechanisms. By introducing a mixed information matrix based on motifs, the generation process of graph attention coefficients is improved, allowing the model to capture higher-order structural features. Compared with the latest research on various graph neural networks, both MGAT and MGATv2 achieve good results in node classification tasks. Furthermore, through various experimental studies on real datasets, we demonstrate that the introduction of network structural motifs can effectively enhance the expressive power of graph neural networks, indicating that both high-order structural features and attribute features are important components of network feature learning.

mathematics
Multi-grained Semantics-aware Graph Neural Networks

Zhiqiang Zhong,Cheng-Te Li,Jun Pang

DOI: https://doi.org/10.1109/tkde.2022.3195004

IF: 9.235

2022-01-01

IEEE Transactions on Knowledge and Data Engineering

Abstract:Graph Neural Networks (GNNs) are powerful techniques in representation learning for graphs and have been increasingly deployed in a multitude of different applications that involve node- and graph-wise tasks. Most existing studies solve either the node-wise task or the graph-wise task independently while they are inherently correlated. This work proposes a unified model, AdamGNN, to interactively learn node and graph representations in a mutual-optimisation manner. Compared with existing GNN models and graph pooling methods, AdamGNN enhances the node representation with the learned multi-grained semantics and avoids losing node features and graph structure information during pooling. Specifically, a differentiable pooling operator is proposed to adaptively generate a multi-grained structure that involves meso- and macro-level semantic information in the graph. We also devise the unpooling operator and the flyback aggregator in AdamGNN to better leverage the multi-grained semantics to enhance node representations. The updated node representations can further adjust the graph representation in the next iteration. Experiments on 14 real-world graph datasets show that AdamGNN can significantly outperform 17 competing models on both node- and graph-wise tasks. The ablation studies confirm the effectiveness of AdamGNN's components, and the last empirical analysis further reveals the ingenious ability of AdamGNN in capturing long-range interactions.

computer science, information systems, artificial intelligence,engineering, electrical & electronic
Megnn: Meta-path extracted graph neural network for heterogeneous graph representation learning

Yaomin Chang,Chuan Chen,Weibo Hu,Zibin Zheng,Xiaocong Zhou,Shouzhi Chen

DOI: https://doi.org/10.1016/j.knosys.2021.107611

2022-01-01

Abstract:Heterogeneous graphs with multiple types of nodes and edges are ubiquitous in the real world and possess immense value in many graph-based downstream applications. However, the heterogeneity within nodes and edges in heterogeneous graphs has brought pressing challenges for practical node representation learning. Existing works manually define multiple meta-paths to model the semantic relationships in heterogeneous graphs. Such strategies heavily rely on the quality of domain knowledge and require extensive hand-crafted works. In this paper, we propose a novel Meta-path Extracted heterogeneous Graph Neural Network (Megnn) that is capable of extracting meaningful meta-paths in heterogeneous graphs, providing insights about data and explainable conclusions to the model’s effectiveness. Concretely, Megnn leverages heterogeneous convolution to combine different bipartite sub-graphs corresponding to edge types into a new trainable graph structure. By adopting the message passing paradigm of GNNs through trainable convolved graphs, Megnn can optimize and extract effective meta-paths for heterogeneous graph representation learning. To enhance the robustness of Megnn, we leverage multiple channels to yield various graph structures and devise a channel consistency regularizer to enforce the node embeddings learned from different channels to be similar. Extensive experimental results on three datasets not only show the effectiveness of Megnn compared with the state-of-the-art methods, but also demonstrate the favorable interpretability of the extracted meta-paths.

computer science, artificial intelligence
Multi-head multi-order graph attention networks

Jie Ben,Qiguo Sun,Keyu Liu,Xibei Yang,Fengjun Zhang

DOI: https://doi.org/10.1007/s10489-024-05601-z

IF: 5.3

2024-06-21

Applied Intelligence

Abstract:The Graph Attention Network (GAT) is a type of graph neural network (GNN) that uses attention mechanisms to weigh the importance of nodes' neighbors, demonstrating flexibility and power in representation learning. However, GAT and its variants still face common challenges in GNNs, such as over-smoothing and over-squashing. To address this, we propose Multi-Head Multi-Order Graph Attention Networks (MHMOGAT) as an enhanced GAT layer. MHMOGAT is built based on multi-head attention and adjacency matrices of different orders, aiming to expand the receptive field of GAT to effectively capture long-distance dependencies. Moreover, Bayesian optimization is employed to determine optimal hyperparameter combinations for different datasets. Experimental results on six prevailing datasets demonstrate that MHMOGAT improves GAT accuracy by approximately 2-5% across various datasets with different label rates, indicating its effectiveness. Additionally, MHMOGAT exhibits potential in handling large and complex graphs with low label rates.

computer science, artificial intelligence
HGNN-QSSA: Heterogeneous Graph Neural Networks With Quantitative Sampling and Structure-Aware Attention

Qin Zhao,Yaru Miao,Dongdong An,Jie Lian,Maozhen Li

DOI: https://doi.org/10.1109/access.2024.3366231

IF: 3.9

2024-02-28

IEEE Access

Abstract:Heterogeneous information networks provide abundant structural and semantic information. Two main strategies for leveraging this data include meta-path-based and meta-path-free methods. The effectiveness of the former heavily depends on the quality of manually defined meta-paths, which may lead to the instability of the model. However, the existing meta-path-free methods lack of neighbor screening during aggregating, and there is also an overemphasis on attribute information. To address these issues, we propose the Heterogeneous Graph Neural Network model by incorporating Quantitative Sampling and Structure-aware Attention. We introduce a Quantitative Sampling Module that calculates the similarity between neighbors of the target nodes and target nodes, enabling us to select the top k nodes with the strongest relevance to the target node based on this measure, and incorporate a Structure-aware Attention Module during the aggregation of neighbor information. This module combines both structural and attribute information to aggregate the neighbor information effectively. By implementing these improvements, our proposed model exhibits superior performance compared to several state-of-the-art methods on two real-world datasets.

computer science, information systems,telecommunications,engineering, electrical & electronic
Meta-Weight Graph Neural Network: Push the Limits Beyond Global Homophily

Xiaojun Ma,Qin Chen,Yuanyi Ren,Guojie Song,Liang Wang

DOI: https://doi.org/10.1145/3485447.3512100

2022-01-01

Abstract:Graph Neural Networks (GNNs) show strong expressive power on graph data mining, by aggregating information from neighbors and using the integrated representation in the downstream tasks. The same aggregation methods and parameters for each node in a graph are used to enable the GNNs to utilize the homophily relational data. However, not all graphs are homophilic, even in the same graph, the distributions may vary significantly. Using the same convolution over all nodes may lead to the ignorance of various graph patterns. Furthermore, many existing GNNs integrate node features and structure identically, which ignores the distributions of nodes and further limits the expressive power of GNNs. To solve these problems, we propose Meta Weight Graph Neural Network (MWGNN) to adaptively construct graph convolution layers for different nodes. First, we model the Node Local Distribution (NLD) from node feature, topological structure and positional identity aspects with the Meta-Weight. Then, based on the Meta-Weight, we generate the adaptive graph convolutions to perform a node-specific weighted aggregation and boost the node representations. Finally, we design extensive experiments on real-world and synthetic benchmarks to evaluate the effectiveness of MWGNN. These experiments show the excellent expressive power of MWGNN in dealing with graph data with various distributions.
Self-Attention Empowered Graph Convolutional Network for Structure Learning and Node Embedding

Mengying Jiang,Guizhong Liu,Yuanchao Su,Xinliang Wu

2024-03-06

Abstract:In representation learning on graph-structured data, many popular graph neural networks (GNNs) fail to capture long-range dependencies, leading to performance degradation. Furthermore, this weakness is magnified when the concerned graph is characterized by heterophily (low homophily). To solve this issue, this paper proposes a novel graph learning framework called the graph convolutional network with self-attention (GCN-SA). The proposed scheme exhibits an exceptional generalization capability in node-level representation learning. The proposed GCN-SA contains two enhancements corresponding to edges and node features. For edges, we utilize a self-attention mechanism to design a stable and effective graph-structure-learning module that can capture the internal correlation between any pair of nodes. This graph-structure-learning module can identify reliable neighbors for each node from the entire graph. Regarding the node features, we modify the transformer block to make it more applicable to enable GCN to fuse valuable information from the entire graph. These two enhancements work in distinct ways to help our GCN-SA capture long-range dependencies, enabling it to perform representation learning on graphs with varying levels of homophily. The experimental results on benchmark datasets demonstrate the effectiveness of the proposed GCN-SA. Compared to other outstanding GNN counterparts, the proposed GCN-SA is competitive.

Machine Learning,Social and Information Networks
Advancing Graph Neural Networks with HL-HGAT: A Hodge-Laplacian and Attention Mechanism Approach for Heterogeneous Graph-Structured Data

Jinghan Huang,Qiufeng Chen,Yijun Bian,Pengli Zhu,Nanguang Chen,Moo K. Chung,Anqi Qiu

DOI: https://doi.org/10.48550/arXiv.2403.06687

IF: 5.414

2024-03-11

Machine Learning

Abstract:Graph neural networks (GNNs) have proven effective in capturing relationships among nodes in a graph. This study introduces a novel perspective by considering a graph as a simplicial complex, encompassing nodes, edges, triangles, and $k$-simplices, enabling the definition of graph-structured data on any $k$-simplices. Our contribution is the Hodge-Laplacian heterogeneous graph attention network (HL-HGAT), designed to learn heterogeneous signal representations across $k$-simplices. The HL-HGAT incorporates three key components: HL convolutional filters (HL-filters), simplicial projection (SP), and simplicial attention pooling (SAP) operators, applied to $k$-simplices. HL-filters leverage the unique topology of $k$-simplices encoded by the Hodge-Laplacian (HL) operator, operating within the spectral domain of the $k$-th HL operator. To address computation challenges, we introduce a polynomial approximation for HL-filters, exhibiting spatial localization properties. Additionally, we propose a pooling operator to coarsen $k$-simplices, combining features through simplicial attention mechanisms of self-attention and cross-attention via transformers and SP operators, capturing topological interconnections across multiple dimensions of simplices. The HL-HGAT is comprehensively evaluated across diverse graph applications, including NP-hard problems, graph multi-label and classification challenges, and graph regression tasks in logistics, computer vision, biology, chemistry, and neuroscience. The results demonstrate the model's efficacy and versatility in handling a wide range of graph-based scenarios.
Hypergraph Transformer Neural Networks

Mengran Li,Yong Zhang,Xiaoyong Li,Yuchen Zhang,Baocai Yin

DOI: https://doi.org/10.1145/3565028

IF: 4.157

2023-04-07

ACM Transactions on Knowledge Discovery from Data

Abstract:Graph neural networks (GNNs) have been widely used for graph structure learning and achieved excellent performance in tasks such as node classification and link prediction. Real-world graph networks imply complex and various semantic information and are often referred to as heterogeneous information networks (HINs). Previous GNNs have laboriously modeled heterogeneous graph networks with pairwise relations, in which the semantic information representation for learning is incomplete and severely hinders node embedded learning. Therefore, the conventional graph structure cannot satisfy the demand for information discovery in HINs. In this article, we propose an end-to-end hypergraph transformer neural network (HGTN) that exploits the communication abilities between different types of nodes and hyperedges to learn higher-order relations and discover semantic information. Specifically, attention mechanisms weigh the importance of semantic information hidden in original HINs to generate useful meta-paths. Meanwhile, our method develops a multi-scale attention module to aggregate node embeddings in higher-order neighborhoods. We evaluate the proposed model with node classification tasks on six datasets: DBLP, ACM, IBDM, Reuters, STUD-BJUT, and Citeseer. Experiments on a large number of benchmarks show the advantages of HGTN.

computer science, information systems, software engineering
Heterophily-Aware Graph Attention Network

Junfu Wang,Yuanfang Guo,Liang Yang,Yunhong Wang

2024-06-30

Abstract:Graph Neural Networks (GNNs) have shown remarkable success in graph representation learning. Unfortunately, current weight assignment schemes in standard GNNs, such as the calculation based on node degrees or pair-wise representations, can hardly be effective in processing the networks with heterophily, in which the connected nodes usually possess different labels or features. Existing heterophilic GNNs tend to ignore the modeling of heterophily of each edge, which is also a vital part in tackling the heterophily problem. In this paper, we firstly propose a heterophily-aware attention scheme and reveal the benefits of modeling the edge heterophily, i.e., if a GNN assigns different weights to edges according to different heterophilic types, it can learn effective local attention patterns, which enable nodes to acquire appropriate information from distinct neighbors. Then, we propose a novel Heterophily-Aware Graph Attention Network (HA-GAT) by fully exploring and utilizing the local distribution as the underlying heterophily, to handle the networks with different homophily ratios. To demonstrate the effectiveness of the proposed HA-GAT, we analyze the proposed heterophily-aware attention scheme and local distribution exploration, by seeking for an interpretation from their mechanism. Extensive results demonstrate that our HA-GAT achieves state-of-the-art performances on eight datasets with different homophily ratios in both the supervised and semi-supervised node classification tasks.

Machine Learning,Social and Information Networks
Improving Graph Neural Networks with Structural Adaptive Receptive Fields

Xiaojun Ma,Junshan Wang,Hanyue Chen,Guojie Song

DOI: https://doi.org/10.1145/3442381.3449896

2021-01-01

Abstract:The abundant information in graphs helps us to learn more expressive node representations. Different nodes in the neighborhood have different importance to the central node. Thus, average weight aggregation in most Graph Neural Networks would fail to model such difference. GAT-based models introduce the attention mechanism to solve this problem, but they ignore the rich structural information and may suffer from the problem of over-smoothing. In this paper, we propose Graph Neural Networks with STructural Adaptive Receptive fields (STAR-GNN), which adaptively construct a receptive field for each node with structural information and further achieve better aggregation of information. Firstly, we model local structural distribution based on anonymous random walks, followed by using the structural information to construct receptive fields guided with mutual information. Then, as the generated receptive fields are irregular, we design a sub-graph aggregator to boost node representations and theoretically prove that it has the ability to capture the complex structures in receptive fields. Experimental results demonstrate the power of STAR-GNN in learning structural receptive fields adaptively and encoding more informative structural characteristics in real-world networks.

Basic molecular biology.

NGAT: Attention in Breadth and Depth Exploration for Semi-Supervised Graph Representation Learning

A Unified Structure Learning Framework for Graph Attention Networks

Heterogeneous Graph Transformer for Meta-structure Learning with Application in Text Classification

Meta-path-based heterogeneous graph neural networks in academic network

Self-supervised Graph Representations with Generative Adversarial Learning

Heterogeneous Information Network Embedding with Meta-path Based Graph Attention Networks.

SHGNN: Structure-Aware Heterogeneous Graph Neural Network

MGATs: Motif-Based Graph Attention Networks

Multi-grained Semantics-aware Graph Neural Networks

Megnn: Meta-path extracted graph neural network for heterogeneous graph representation learning

Multi-head multi-order graph attention networks

HGNN-QSSA: Heterogeneous Graph Neural Networks With Quantitative Sampling and Structure-Aware Attention

Meta-Weight Graph Neural Network: Push the Limits Beyond Global Homophily

Self-Attention Empowered Graph Convolutional Network for Structure Learning and Node Embedding

Advancing Graph Neural Networks with HL-HGAT: A Hodge-Laplacian and Attention Mechanism Approach for Heterogeneous Graph-Structured Data

Hypergraph Transformer Neural Networks

Heterophily-Aware Graph Attention Network

Improving Graph Neural Networks with Structural Adaptive Receptive Fields