Abstract:Recent years have witnessed the rapid development of heterogeneous graph neural networks (HGNNs) in information retrieval (IR) applications. Many existing HGNNs design a variety of tailor-made graph convolutions to capture structural and semantic information in heterogeneous graphs. However, existing HGNNs usually represent each node as a single vector in the multi-layer graph convolution calculation, which makes the high-level graph convolution layer fail to distinguish information from different relations and different orders, resulting in the information loss in the message passing. %insufficient mining of information. To this end, we propose a novel heterogeneous graph neural network with sequential node representation, namely Seq-HGNN. To avoid the information loss caused by the single vector node representation, we first design a sequential node representation learning mechanism to represent each node as a sequence of meta-path representations during the node message passing. Then we propose a heterogeneous representation fusion module, empowering Seq-HGNN to identify important meta-paths and aggregate their representations into a compact one. We conduct extensive experiments on four widely used datasets from Heterogeneous Graph Benchmark (HGB) and Open Graph Benchmark (OGB). Experimental results show that our proposed method outperforms state-of-the-art baselines in both accuracy and efficiency. The source code is available at <a class="link-external link-https" href="https://github.com/nobrowning/SEQ_HGNN" rel="external noopener nofollow">this https URL</a>.

Graph2Seq: Graph to Sequence Learning with Attention-based Neural Networks.

GraphSeq2Seq: Graph-Sequence-to-Sequence for Neural Machine Translation

Graph Transformer for Graph-to-Sequence Learning

Graph Sequence Neural Network with an Attention Mechanism for Traffic Speed Prediction

Line Graph Enhanced Amr-To-Text Generation With Mix-Order Graph Attention Networks

Graph-to-Tree Neural Networks for Learning Structured Input-Output Translation with Applications to Semantic Parsing and Math Word Problem.

Gated Graph Neural Attention Networks for abstractive summarization

Heterogeneous Graph Transformer for Graph-to-Sequence Learning

Densely Connected Graph Convolutional Networks for Graph-to-Sequence Learning

An end-to-end attention-based approach for learning on graphs

Graph Sequential Network for Reasoning over Sequences

Seq-HGNN: Learning Sequential Node Representation on Heterogeneous Graph

Graph augmented sequence-to-sequence model for neural question generation

Reinforcement Learning Based Graph-to-Sequence Model for Natural Question Generation

Graph Alignment Neural Network Model With Graph to Sequence Learning

Seq-HyGAN: Sequence Classification via Hypergraph Attention Network

Graph-to-Sequence Neural Machine Translation

To Understand Representation of Layer-aware Sequence Encoders as Multi-order-graph

Pervasive Attention: 2D Convolutional Neural Networks for Sequence-to-Sequence Prediction

A Graph Sequence Neural Architecture for Code Completion with Semantic Structure Features