Semi-Supervised Graph Neural Network with Probabilistic Modeling to Mitigate Uncertainty

Maria Vaida,Pranita Patil
DOI: https://doi.org/10.1145/3404663.3404680
2020-05-15
Abstract:Probabilistic Graph Neural Network (PGNN) introduced here proposes a machine learning application that combines deep learning on graphs with probabilistic modeling, to account for uncertainty in both inputs and outputs. Graph neural network models (GNNs) have been extensively used in modeling graph-structured data. However this class of models learn point estimates conditioned on arbitrary weights initializations, which can lead to poor convergence and sub-optimal generalization. By enhancing deep learning with Bayesian modeling, PGNN aims to strengthen the prediction accuracy, and provide more stable predictions. In order to achieve this goal, PGNN learns a distribution over network weights and encodings, thus solving the epistemic and aleatoric uncertainty inherited in network parameters and model predictions. Through Markov Chain Monte Carlo Random Walk Metropolis sampling of weights and likelihood distributions, PGNN essentially generates an ensemble of models in one iteration, computing an estimate of credible intervals over the predictions. PGNN is applied to the task of semi-supervised node classification and tested on 3 benchmark datasets, yielding improved accuracy, and more stable predictions when compared with standard GNNs and other Bayesian graph models.
What problem does this paper attempt to address?