Revisiting Graph Neural Networks for Node Classification in Heterogeneous Graphs.

Ye Tao,Ying Li,Zhonghai Wu
DOI: https://doi.org/10.1109/ICME51207.2021.9428354
2021-01-01
Abstract:Graph Neural Networks (GNNs) have become the predominant technique for learning over graphs. However, there is little understanding of why GNNs are successful in practice. In this paper, we revisit GNNs for node classification tasks and find that GNNs mainly gain from iterative message aggregation, performing embedding transformation during aggregation leads to over-fitting and poor performance. Furthermore, the over-fitting problem is more severe in heterogeneous GNNs because of more complex operations. Driven by these findings, we propose a highway heterogeneous graph attention network that decouples message aggregation and embedding transformation to alleviate the over-fitting problem. To model heterogeneous structures, we design a hierarchical attention mechanism and a node-type dependent gate mechanism. Extensive experimental results show that our model has superior performance over the state-of-the-art methods.
What problem does this paper attempt to address?