Abstract:Recently, the deep learning community has given growing attention to neural architectures engineered to learn problems in relational domains. Convolutional Neural Networks employ parameter sharing over the image domain, tying the weights of neural connections on a grid topology and thus enforcing the learning of a number of convolutional kernels. By instantiating trainable neural modules and assembling them in varied configurations (apart from grids), one can enforce parameter sharing over graphs, yielding models which can effectively be fed with relational data. In this context, vertices in a graph can be projected into a hyperdimensional real space and iteratively refined over many message-passing iterations in an end-to-end differentiable architecture. Architectures of this family have been referred to with several definitions in the literature, such as Graph Neural Networks, Message-passing Neural Networks, Relational Networks and Graph Networks. In this paper, we revisit the original Graph Neural Network model and show that it generalises many of the recent models, which in turn benefit from the insight of thinking about vertex \textbf{types}. To illustrate the generality of the original model, we present a Graph Neural Network formalisation, which partitions the vertices of a graph into a number of types. Each type represents an entity in the ontology of the problem one wants to learn. This allows - for instance - one to assign embeddings to edges, hyperedges, and any number of global attributes of the graph. As a companion to this paper we provide a Python/Tensorflow library to facilitate the development of such architectures, with which we instantiate the formalisation to reproduce a number of models proposed in the current literature.

Variants for Different Graph Types

Graph Neural Networks Designed for Different Graph Types: A Survey

Vanilla Graph Neural Networks

Graph Neural Networks for Small Graph and Giant Network Representation Learning: An Overview

Variants for Advanced Training Methods

Architectural Implications of Graph Neural Networks.

On Positional and Structural Node Features for Graph Neural Networks on Non-attributed Graphs

Typed Graph Networks

Graph Neural Networks in Computer Vision -- Architectures, Datasets and Common Approaches

Two-level Graph Neural Network

What Do GNNs Actually Learn? Towards Understanding their Representations

Learning the Network of Graphs for Graph Neural Networks

Toward the Analysis of Graph Neural Networks

Graph Neural Network (GNN) in Image and Video Understanding Using Deep Learning for Computer Vision Applications

Introduction to Graph Neural Networks

A Survey on Graph Classification and Link Prediction based on GNN

Neural Trees for Learning on Graphs

Graph neural network variants in traffic forecasting: A review

The graph neural network model

Local-to-global Perspectives on Graph Neural Networks