Abstract:The adaptive processing of structured data is a long-standing research topic in machine learning that investigates how to automatically learn a mapping from a structured input to outputs of various nature. Recently, there has been an increasing interest in the adaptive processing of graphs, which led to the development of different neural network-based methodologies. In this thesis, we take a different route and develop a Bayesian Deep Learning framework for graph learning. The dissertation begins with a review of the principles over which most of the methods in the field are built, followed by a study on graph classification reproducibility issues. We then proceed to bridge the basic ideas of deep learning for graphs with the Bayesian world, by building our deep architectures in an incremental fashion. This framework allows us to consider graphs with discrete and continuous edge features, producing unsupervised embeddings rich enough to reach the state of the art on several classification tasks. Our approach is also amenable to a Bayesian nonparametric extension that automatizes the choice of almost all model's hyper-parameters. Two real-world applications demonstrate the efficacy of deep learning for graphs. The first concerns the prediction of information-theoretic quantities for molecular simulations with supervised neural models. After that, we exploit our Bayesian models to solve a malware-classification task while being robust to intra-procedural code obfuscation techniques. We conclude the dissertation with an attempt to blend the best of the neural and Bayesian worlds together. The resulting hybrid model is able to predict multimodal distributions conditioned on input graphs, with the consequent ability to model stochasticity and uncertainty better than most works. Overall, we aim to provide a Bayesian perspective into the articulated research field of deep learning for graphs.

Contextual Graph Markov Model: A Deep and Generative Approach to Graph Processing

SCGG: A deep structure-conditioned graph generative model

DBGDGM: Dynamic Brain Graph Deep Generative Model

Graph Models for Contextual Intention Prediction in Dialog Systems

Generative Model for Node Generation.

vGraph: A Generative Model for Joint Community Detection and Node Representation Learning

Scalable Deep Generative Modeling for Sparse Graphs

Contextual Directed Acyclic Graphs

Deep Generative Models for Subgraph Prediction

Bayesian Deep Learning for Graphs

Context-Aware Auto-Encoded Graph Neural Model for Dynamic Question Generation using NLP

Graph Neural Network for Context-Aware Recommendation

Retrieval Augmented Generation for Dynamic Graph Modeling

Graphusion: Latent Diffusion for Graph Generation

When Graph Data Meets Multimodal: A New Paradigm for Graph Understanding and Reasoning

A generative neural network model for random dot product graphs

Disentangled Spatiotemporal Graph Generative Models

Deep Graph Attention Model

Deep learning for dynamic graphs: models and benchmarks

Deep Neural Networks for Learning Graph Representations