Abstract:Graph Neural Networks (GNNs) such as Graph Convolutional Networks (GCN) can effectively learn node representations via aggregating neighbors based on the relation graph. However, despite a few exceptions, most of the previous work in this line does not consider the topical semantics underlying the edges, making the node representations less effective and the learned relation between nodes hard to explain. For instance, the current GNNs make us usually don’t know what is the reason for the connection of network nodes, such as the specific research topics cited in the paper and the concerns among friends on social platforms. Some methods have begun to explore the extraction of relation semantics in recent related literature, but existing studies generally face two bottlenecks, i.e., either being unable to explain the mined latent relations to ensure their reasonableness and independence, or demanding the textual content of edges which is unavailable in most real-world datasets. Actually, these two issues are both crucial in practical use. In our work, we propose a novel Topic-Disentangled Graph Neural Network (TDG) to address the above two issues at the same time, which explores the relation topics from the perspective of node contents. We design an optimized graph topic module to handle node features to construct independent and explainable semantic subspaces, then the reasonable relation topics that correspond to these subspaces are assigned to each graph relation via a neighborhood routing mechanism. Our proposed model can be easily combined with related graph tasks to form an end-to-end model, to avoid the risk of deviation between node representation space and task space. To evaluate the efficiency of our model, sufficient node-related tasks are conducted on three public datasets in the experimental section. The results show the obvious superiority of TDG compared with the state-of-the-art models.

Taxonomy-Enhanced Graph Neural Networks

Mixed Geometry Message and Trainable Convolutional Attention Network for Knowledge Graph Completion

NGAT: Attention in Breadth and Depth Exploration for Semi-Supervised Graph Representation Learning

Tensor-view Topological Graph Neural Network

A data-centric framework of improving graph neural networks for knowledge graph embedding

Graph neural networks for multi-view learning: a taxonomic review

Graph Neural Networks: Taxonomy, Advances and Trends

Graph Neural Networks: Taxonomy, Advances, and Trends

Efficient Topology-aware Data Augmentation for High-Degree Graph Neural Networks

Taxonomy of Benchmarks in Graph Representation Learning

Learning the Explainable Semantic Relations via Unified Graph Topic-Disentangled Neural Networks

TANGNN: a Concise, Scalable and Effective Graph Neural Networks with Top-m Attention Mechanism for Graph Representation Learning

Fine-Tuning Graph Neural Networks Via Graph Topology Induced Optimal Transport

Graph Neural Networks for Tabular Data Learning: A Survey with Taxonomy and Directions

Learning Graph Neural Networks with Positive and Unlabeled Nodes

Torsion Graph Neural Networks

Unsupervised Graph Structure Learning Based on Optimal Graph Topology Modeling and Adaptive Data Augmentation

Graph topology enhancement for text classification

Neural Trees for Learning on Graphs

GANTEE: Generative Adversatial Network for Taxonomy Entering Evaluation

GANTEE: Generative Adversarial Network for Taxonomy Enterance Evaluation