Abstract:Although many graph convolutional neural networks (GCNNs) have achieved superior performances in semisupervised node classification, they are designed from either the spatial or spectral perspective, yet without a general theoretical basis. Besides, most of the existing GCNNs methods tend to ignore the ubiquitous noises in the network topology and node content and are thus unable to model these uncertainties. These drawbacks certainly reduce their effectiveness in integrating network topology and node content. To provide a probabilistic perspective to the GCNNs, we model the semisupervised node classification problem as a topology-constrained probabilistic latent space model, probabilistic graph convolutional network (PGCN). By representing the nodes in a more efficient distribution form, the proposed framework can seamlessly integrate the node content and network topology. When specifying the distribution in PGCN to be a Gaussian distribution, the transductive node classification problems can be solved by the general framework and a specific method, called PGCN with the Gaussian distribution representation (PGCN-G), is proposed. To overcome the overfitting problem in covariance estimation and reduce the computational complexity, PGCN-G is further improved to PGCN-G+ by imposing the covariance matrices of all vertices to possess the identical singular vectors. The optimization algorithm based on expectation-maximization indicates that the proposed method can iteratively denoise the network topology and node content with respect to each other. Besides the effectiveness of this top-down framework demonstrated via extensive experiments, it can also be deduced to cover the existing methods, graph convolutional network, graph attention network, and Gaussian mixture model and elaborate their characteristics and relationships by specific derivations.

Phase Transitions and Optimal Algorithms for Semisupervised Classifications on Graphs: from Belief Propagation to Graph Convolution Network

Phase transitions and optimal algorithms for semi-supervised classifications on graphs: from belief propagation to graph convolution network

Probabilistic Graph Convolutional Network Via Topology-Constrained Latent Space Model.

From Cluster Assumption to Graph Convolution: Graph-based Semi-Supervised Learning Revisited

Semi-Supervised Graph Classification: A Hierarchical Graph Perspective

Optimal Exact Recovery in Semi-Supervised Learning: A Study of Spectral Methods and Graph Convolutional Networks

Optimization of Graph Clustering Inspired by Dynamic Belief Systems

Semisupervised Graph Neural Networks for Graph Classification

Learnable Graph Convolutional Network with Semisupervised Graph Information Bottleneck.

Adaptive Graph Convolutional Clustering Network with Optimal Probabilistic Graph

Structured graph learning for clustering and semi-supervised classification

Graph Stochastic Neural Networks for Semi-supervised Learning.

Dual Graph Convolutional Networks for Graph-Based Semi-Supervised Classification

Combining Smooth Graphs with Semi-supervised Classification

Bayesian Graph Convolutional Neural Networks for Semi-Supervised Classification

Semi-Supervised Node Classification on Graphs: Markov Random Fields vs. Graph Neural Networks

Towards Semi-supervised Universal Graph Classification

Semi-supervised Clustering of Graph Objects: A Subgraph Mining Approach

Fairness in graph-based semi-supervised learning

Two-order Graph Convolutional Networks for Semi-Supervised Classification.

Graph Belief Propagation Networks