Abstract:A graph is a powerful concept for representation of relations between pairs of entities. Data with underlying graph structure can be found across many disciplines and there is a natural desire for understanding such data better. Deep learning (DL) has achieved significant breakthroughs in a variety of machine learning tasks in recent years, especially where data is structured on a grid, such as in text, speech, or image understanding. However, surprisingly little has been done to explore the applicability of DL on arbitrary graph-structured data directly. The goal of this thesis is to investigate architectures for DL on graphs and study how to transfer, adapt or generalize concepts that work well on sequential and image data to this domain. We concentrate on two important primitives: embedding graphs or their nodes into a continuous vector space representation (encoding) and, conversely, generating graphs from such vectors back (decoding). To that end, we make the following contributions. First, we introduce Edge-Conditioned Convolutions (ECC), a convolution-like operation on graphs performed in the spatial domain where filters are dynamically generated based on edge attributes. The method is used to encode graphs with arbitrary and varying structure. Second, we propose SuperPoint Graph, an intermediate point cloud representation with rich edge attributes encoding the contextual relationship between object parts. Based on this representation, ECC is employed to segment large-scale point clouds without major sacrifice in fine details. Third, we present GraphVAE, a graph generator allowing us to decode graphs with variable but upper-bounded number of nodes making use of approximate graph matching for aligning the predictions of an autoencoder with its inputs. The method is applied to the task of molecule generation.

DeepGraph: A PyCharm tool for visualizing and understanding deep learning models

DeepGD: A Deep Learning Framework for Graph Drawing Using GNN

DeepDrawing: A Deep Learning Approach to Graph Drawing

CogDL: An Extensive Toolkit for Deep Learning on Graphs

NeuralVis: Visualizing and Interpreting Deep Learning Models

Towards Efficient Visual Simplification of Computational Graphs in Deep Neural Networks

Towards A Visual Programming Tool to Create Deep Learning Models

Understanding Neural Networks Through Deep Visualization

DGL-LifeSci: An Open-Source Toolkit for Deep Learning on Graphs in Life Science

Deep Feature Learning for Graphs

Deep Learning on Attributed Graphs: A Journey from Graphs to Their Embeddings and Back

DeepE: a deep neural network for knowledge graph embedding

An In-Situ Visual Analytics Framework for Deep Neural Networks

Visual Genealogy of Deep Neural Networks

DeepTEGINN: Deep Learning Based Tools to Extract Graphs from Images of Neural Networks

Extracting knowledge from Deep Neural Networks through graph analysis

XDeep: an Interpretation Tool for Deep Neural Networks.

Deep Learning for Learning Graph Representations

CogDL: A Comprehensive Library for Graph Deep Learning

Deep geometric knowledge distillation with graphs

GraphNeuralNetworks.jl: Deep Learning on Graphs with Julia