Abstract:Graph Neural Networks (GNNs) have led to state-of-the-art performance on a variety of machine learning tasks such as recommendation, node classification and link prediction. Graph neural network models generate node embeddings by merging nodes features with the aggregated neighboring nodes information. Most existing GNN models exploit a single type of aggregator (e.g., mean-pooling) to aggregate neighboring nodes information, and then add or concatenate the output of aggregator to the current representation vector of the center node. However, using only a single type of aggregator is difficult to capture the different aspects of neighboring information and the simple addition or concatenation update methods limit the expressive capability of GNNs. Not only that, existing supervised or semi-supervised GNN models are trained based on the loss function of the node label, which leads to the neglect of graph structure information. In this paper, we propose a novel graph neural network architecture, Graph Attention & Interaction Network (GAIN), for inductive learning on graphs. Unlike the previous GNN models that only utilize a single type of aggregation method, we use multiple types of aggregators to gather neighboring information in different aspects and integrate the outputs of these aggregators through the aggregator-level attention mechanism. Furthermore, we design a graph regularized loss to better capture the topological relationship of the nodes in the graph. Additionally, we first present the concept of graph feature interaction and propose a vector-wise explicit feature interaction mechanism to update the node embeddings. We conduct comprehensive experiments on two node-classification benchmarks and a real-world financial news dataset. The experiments demonstrate our GAIN model outperforms current state-of-the-art performances on all the tasks.

TANGNN: a Concise, Scalable and Effective Graph Neural Networks with Top-m Attention Mechanism for Graph Representation Learning

Graph Transformer Networks Based Text Representation.

From Stars to Subgraphs: Uplifting Any GNN with Local Structure Awareness

SpikeGraphormer: A High-Performance Graph Transformer with Spiking Graph Attention

GAIN: Graph Attention & Interaction Network for Inductive Semi-Supervised Learning over Large-scale Graphs

Large-scale Online Multi-View Graph Neural Network and Applications

The Expressive Power of Graph Neural Networks: A Survey

Graph Neural Networks Inspired by Classical Iterative Algorithms

Ha-gnn: a novel graph neural network based on hyperbolic attention

Can Transformer and GNN Help Each Other?

Node Feature Extraction by Self-Supervised Multi-scale Neighborhood Prediction

Diffusing to the Top: Boost Graph Neural Networks with Minimal Hyperparameter Tuning

TransGNN: Harnessing the Collaborative Power of Transformers and Graph Neural Networks for Recommender Systems

A Multi-Granularity Heterogeneous Graph for Extractive Text Summarization

Xgcn: an Extreme Graph Convolutional Network for Large-scale Social Link Prediction

A Graph Neural Network Fused with Multi-Head Attention for Text Classification

Transferable graph neural networks with deep alignment attention

Graph Transformer: Learning Better Representations for Graph Neural Networks.

Graph Attention Multi-Layer Perceptron

API-GNN: attribute preserving oriented interactive graph neural network

Attention-based graph neural networks: a survey