Abstract:In the area of large-scale graph data representation and semi-supervised learning, deep graph-based convolutional neural networks have been widely applied. However, typical graph convolutional network (GCN) aggregates information of neighbor nodes based on binary neighborhood similarity (adjacency matrix). It treats all neighbor nodes of one node equally, which does not suppress the influence of dissimilar neighbor nodes. In this paper, we investigate GCN based on similarity matrix instead of adjacency matrix of graph nodes. Gaussian heat kernel similarity in Euclidean space is first adopted, which is named EGCN. Then biologically inspired manifold similarity is trained in reproducing kernel Hilbert space (RKHS), based on which a manifold GCN (named MGCN) is proposed for graph data representation and semi-supervised learning with four different kernel types. The proposed method is evaluated with extensive experiments on four benchmark document citation network datasets. The objective function of manifold similarity learning converges very quickly on different datasets using various kernel functions. Compared with state-of-the-art methods, our method is very competitive in terms of graph node recognition accuracy. In particular, the recognition rates of MGCN (Gaussian kernel) and MGCN (Polynomial Kernel) outperform that of typical GCN about 3.8% on Cora dataset, 3.5% on Citeseer dataset, 1.3% on Pubmed dataset and 4% on Cora_ML dataset, respectively. Although the proposed MGCN is relatively simple and easy to implement, it can discover local manifold structure by manifold similarity learning and suppress the influence of dissimilar neighbor nodes, which shows the effectiveness of the proposed MGCN.

Graph Manifold Learning with Non-Gradient Decision Layer

Deep Manifold Computing and Visualization

Markov-Lipschitz Deep Learning

Graph Learning in Low Dimensional Space for Graph Convolutional Networks

Deep Manifold Computing and Visualization Using Elastic Locally Isometric Smoothness

A unified deep semi-supervised graph learning scheme based on nodes re-weighting and manifold regularization

Manifold Neural Network With Non-Gradient Optimization

Graph Convolutional Networks based on Manifold Learning for Semi-Supervised Image Classification

Manifold Graph Model For Data Classification Based On Locally Linear Reconstruction Coefficients

Manifold GCN: Diffusion-based Convolutional Neural Network for Manifold-valued Graphs

Human activity recognition by manifold regularization based dynamic graph convolutional networks

Graph Convolutional Network Based on Manifold Similarity Learning

Semi-Supervised Learning with Manifold Fitted Graphs.

HesGCN: Hessian graph convolutional networks for semi-supervised classification

Joint Learning of Graph Representation and Node Features in Graph Convolutional Neural Networks

Deeper Insights Into Graph Convolutional Networks for Semi-Supervised Learning

Graph Stochastic Neural Networks for Semi-supervised Learning.

Linear Manifold Regularization with Adaptive Graph for Semi-Supervised Dimensionality Reduction

Geodesic Gabriel Graph Based Supervised Nonlinear Manifold Learning

A Manifold Perspective on the Statistical Generalization of Graph Neural Networks