GaAN: Gated Attention Networks for Learning on Large and Spatiotemporal Graphs

Jiani Zhang,Xingjian Shi,Junyuan Xie,Hao Ma,Irwin King,Dit-Yan Yeung
DOI: https://doi.org/10.48550/arXiv.1803.07294
2018-03-20
Abstract:We propose a new network architecture, Gated Attention Networks (GaAN), for learning on graphs. Unlike the traditional multi-head attention mechanism, which equally consumes all attention heads, GaAN uses a convolutional sub-network to control each attention head's importance. We demonstrate the effectiveness of GaAN on the inductive node classification problem. Moreover, with GaAN as a building block, we construct the Graph Gated Recurrent Unit (GGRU) to address the traffic speed forecasting problem. Extensive experiments on three real-world datasets show that our GaAN framework achieves state-of-the-art results on both tasks.
Machine Learning,Social and Information Networks
What problem does this paper attempt to address?