Revisiting Attention-Based Graph Neural Networks for Graph Classification

Ye Tao,Ying Li,Zhonghai Wu
DOI: https://doi.org/10.1007/978-3-031-14714-2_31
2022-01-01
Abstract:The attention mechanism is widely used in GNNs to improve performances. However, we argue that it breaks the prerequisite for a GNN model to obtain the maximum expressive power of distinguishing different graph structures. This paper performs theoretical analyses of attention-based GNN models' expressive power on graphs with both node and edge features. We propose an enhanced graph attention network (EGAT) framework based on the analysis to deal with this problem. We add a degree-related scale term to the attention coefficients and adjust the message extraction function to enhance the expressive power, which is critical in the graph classification task. Furthermore, we introduce a virtual node connected with all nodes to augment the node representation update process with global information. To prove the effectiveness of our EGAT framework, we first construct synthetic datasets to validate our theoretical proposal, then we apply EGAT to two Open Graph Benchmark (OGB) graph classification tasks to empirically demonstrate that our model also performs well in real applications.
What problem does this paper attempt to address?