Abstract:Although many graph convolutional neural networks (GCNNs) have achieved superior performances in semisupervised node classification, they are designed from either the spatial or spectral perspective, yet without a general theoretical basis. Besides, most of the existing GCNNs methods tend to ignore the ubiquitous noises in the network topology and node content and are thus unable to model these uncertainties. These drawbacks certainly reduce their effectiveness in integrating network topology and node content. To provide a probabilistic perspective to the GCNNs, we model the semisupervised node classification problem as a topology-constrained probabilistic latent space model, probabilistic graph convolutional network (PGCN). By representing the nodes in a more efficient distribution form, the proposed framework can seamlessly integrate the node content and network topology. When specifying the distribution in PGCN to be a Gaussian distribution, the transductive node classification problems can be solved by the general framework and a specific method, called PGCN with the Gaussian distribution representation (PGCN-G), is proposed. To overcome the overfitting problem in covariance estimation and reduce the computational complexity, PGCN-G is further improved to PGCN-G+ by imposing the covariance matrices of all vertices to possess the identical singular vectors. The optimization algorithm based on expectation-maximization indicates that the proposed method can iteratively denoise the network topology and node content with respect to each other. Besides the effectiveness of this top-down framework demonstrated via extensive experiments, it can also be deduced to cover the existing methods, graph convolutional network, graph attention network, and Gaussian mixture model and elaborate their characteristics and relationships by specific derivations.

VEM-GCN: Topology Optimization with Variational EM for Graph Convolutional Networks

Tackling Over-Smoothing in Graph Convolutional Networks With EM-Based Joint Topology Optimization and Node Classification

Topology Optimization Based Graph Convolutional Network.

Scattering GCN: Overcoming Oversmoothness in Graph Convolutional Networks

Variational Gridded Graph Convolution Network for Node Classification

Revisiting Graph Convolutional Network on Semi-Supervised Node Classification from an Optimization Perspective

Beyond smoothness: A general optimization framework for graph neural networks with negative Laplacian regularization

Probabilistic Graph Convolutional Network Via Topology-Constrained Latent Space Model.

AM-GCN: Adaptive Multi-channel Graph Convolutional Networks

Tackling Over-Smoothing for General Graph Convolutional Networks

Measuring and Relieving the Over-Smoothing Problem for Graph Neural Networks from the Topological View

Graph Convolutional Network with elastic topology

Neighborhood Pattern Is Crucial for Graph Convolutional Networks Performing Node Classification

A Unified Framework for Convolution-Based Graph Neural Networks

On Which Nodes Does GCN Fail? Enhancing GCN from the Node Perspective

Virtual Adversarial Training on Graph Convolutional Networks in Node Classification

RG-GCN: Improved Graph Convolution Neural Network Algorithm Based on Rough Graph

Deeper Insights Into Graph Convolutional Networks for Semi-Supervised Learning

Transfer Entropy in Graph Convolutional Neural Networks

EMGraph: Fast Learning-Based Electromigration Analysis for Multi-Segment Interconnect Using Graph Convolution Networks