Abstract:In recent years, graph neural networks (GNNs) have emerged as a successful tool in a variety of graph-related applications. However, the performance of GNNs can be deteriorated when noisy connections occur in the original graph structures; besides, the dependence on explicit structures prevents GNNs from being applied to general unstructured scenarios. To address these issues, recently emerged deep graph structure learning (GSL) methods propose to jointly optimize the graph structure along with GNN under the supervision of a node classification task. Nonetheless, these methods focus on a supervised learning scenario, which leads to several problems, i.e., the reliance on labels, the bias of edge distribution, and the limitation on application tasks. In this paper, we propose a more practical GSL paradigm, unsupervised graph structure learning, where the learned graph topology is optimized by data itself without any external guidance (i.e., labels). To solve the unsupervised GSL problem, we propose a novel StrUcture Bootstrapping contrastive LearnIng fraMEwork (SUBLIME for abbreviation) with the aid of self-supervised contrastive learning. Specifically, we generate a learning target from the original data as an "anchor graph", and use a contrastive loss to maximize the agreement between the anchor graph and the learned graph. To provide persistent guidance, we design a novel bootstrapping mechanism that upgrades the anchor graph with learned structures during model learning. We also design a series of graph learners and post-processing schemes to model the structures to learn. Extensive experiments on eight benchmark datasets demonstrate the significant effectiveness of our proposed SUBLIME and high quality of the optimized graphs.

A Unified Structure Learning Framework for Graph Attention Networks

NGAT: Attention in Breadth and Depth Exploration for Semi-Supervised Graph Representation Learning

Unified Structure-Aware Feature Learning for Graph Convolutional Network

Hierarchical Graph Representation Learning with Structural Attention for Graph Classification

Structured self-attention architecture for graph-level representation learning

Self-Attention Empowered Graph Convolutional Network for Structure Learning and Node Embedding

Higher-Order Interaction Goes Neural: A Substructure Assembling Graph Attention Network for Graph Classification

Enhancing Graph Representation Learning with Attention-Driven Spiking Neural Networks

UGSL: A Unified Framework for Benchmarking Graph Structure Learning

A Unified Deep Sparse Graph Attention Network for Scene Graph Generation

Meta-structure-based graph attention networks

Graph Structure Learning Based on Feature and Label Consistency.

Robust Graph Structure Learning with the Alignment of Features and Adjacency Matrix

Substructure Aware Graph Neural Networks.

Simple and Deep Graph Attention Networks

GCN-SL: Graph Convolutional Networks with Structure Learning for Graphs under Heterophily

A Survey on Graph Structure Learning: Progress and Opportunities

Towards Unsupervised Deep Graph Structure Learning

DGSLN: Differentiable Graph Structure Learning Neural Network for Robust Graph Representations.

Context-Aware Graph Attention Networks