Abstract:Much of the world's most valued data is stored in relational databases and data warehouses, where the data is organized into many tables connected by primary-foreign key relations. However, building machine learning models using this data is both challenging and time consuming. The core problem is that no machine learning method is capable of learning on multiple tables interconnected by primary-foreign key relations. Current methods can only learn from a single table, so the data must first be manually joined and aggregated into a single training table, the process known as feature engineering. Feature engineering is slow, error prone and leads to suboptimal models. Here we introduce an end-to-end deep representation learning approach to directly learn on data laid out across multiple tables. We name our approach Relational Deep Learning (RDL). The core idea is to view relational databases as a temporal, heterogeneous graph, with a node for each row in each table, and edges specified by primary-foreign key links. Message Passing Graph Neural Networks can then automatically learn across the graph to extract representations that leverage all input data, without any manual feature engineering. Relational Deep Learning leads to more accurate models that can be built much faster. To facilitate research in this area, we develop RelBench, a set of benchmark datasets and an implementation of Relational Deep Learning. The data covers a wide spectrum, from discussions on Stack Exchange to book reviews on the Amazon Product Catalog. Overall, we define a new research area that generalizes graph machine learning and broadens its applicability to a wide set of AI use cases.

From Relational Databases to Belief Networks

A Bayesian Method for Constructing Bayesian Belief Networks from Databases

Link Prediction in Multi-Relational Networks Based on Relational Similarity

Extraction of Belief Knowledge from a Relational Database for Quantitative Bayesian Network Inference

Belief Approach for Social Networks

Recurrent Dirichlet Belief Networks for Interpretable Dynamic Relational Data Modelling

Relational Deep Learning: Graph Representation Learning on Relational Databases

A Theory of Link Prediction via Relational Weisfeiler-Leman on Knowledge Graphs

Learning Class-Level Bayes Nets for Relational Data

Believe It or Not: Adding Belief Annotations to Databases

A Method for Implementing a Probabilistic Model as a Relational Database

A Method for Using Belief Networks as Influence Diagrams

Network Engineering for Complex Belief Networks

Supervised Learning on Relational Databases with Graph Neural Networks

Relational Network Verification

RelBench: A Benchmark for Deep Learning on Relational Databases

Symbolic Querying of Vector Spaces: Probabilistic Databases Meets Relational Embeddings

Exposing Multi-Relational Networks to Single-Relational Network Analysis Algorithms

Behavior-Inspired Neural Networks for Relational Inference

Relational Dynamic Bayesian Networks

Chinese Relation Extraction Based on Deep Belief Nets