Graph Convolutional Neural Networks Via Motif-based Attention

Hao Peng,Jianxin Li,Qiran Gong,Senzhang Wang,Yuanxing Ning,Philip S. Yu
DOI: https://doi.org/10.48550/arxiv.1811.08270
2018-01-01
Abstract:Many real-world problems can be represented as graph-based learning problems.In this paper, we propose a novel framework for learning spatial andattentional convolution neural networks on arbitrary graphs. Different fromprevious convolutional neural networks on graphs, we first design amotif-matching guided subgraph normalization method to capture neighborhoodinformation. Then we implement subgraph-level self-attentional layers to learndifferent importances from different subgraphs to solve graph classificationproblems. Analogous to image-based attentional convolution networks thatoperate on locally connected and weighted regions of the input, we also extendgraph normalization from one-dimensional node sequence to two-dimensional nodegrid by leveraging motif-matching, and design self-attentional layers withoutrequiring any kinds of cost depending on prior knowledge of the graphstructure. Our results on both bioinformatics and social network datasets showthat we can significantly improve graph classification benchmarks overtraditional graph kernel and existing deep models.
What problem does this paper attempt to address?