Abstract:To improve the performance of Graph Neural Networks (GNNs), Graph Structure Learning (GSL) has been extensively applied to reconstruct or refine original graph structures, effectively addressing issues like heterophily, over-squashing, and noisy structures. While GSL is generally thought to improve GNN performance, it often leads to longer training times and more hyperparameter tuning. Besides, the distinctions among current GSL methods remain ambiguous from the perspective of GNN training, and there is a lack of theoretical analysis to quantify their effectiveness. Recent studies further suggest that, under fair comparisons with the same hyperparameter tuning, GSL does not consistently outperform baseline GNNs. This motivates us to ask a critical question: is GSL really useful for GNNs? To address this question, this paper makes two key contributions. First, we propose a new GSL framework, which includes three steps: GSL base (the representation used for GSL) construction, new structure construction, and view fusion, to better understand the effectiveness of GSL in GNNs. Second, after graph convolution, we analyze the differences in mutual information (MI) between node representations derived from the original topology and those from the newly constructed topology. Surprisingly, our empirical observations and theoretical analysis show that no matter which type of graph structure construction methods are used, after feeding the same GSL bases to the newly constructed graph, there is no MI gain compared to the original GSL bases. To fairly reassess the effectiveness of GSL, we conduct ablation experiments and find that it is the pretrained GSL bases that enhance GNN performance, and in most cases, GSL cannot improve GNN performance. This finding encourages us to rethink the essential components in GNNs, such as self-training and structural encoding, in GNN design rather than GSL.

Gated Bi-View Graph Structure Learning.

Contrastive Multi-view Learning for Graph Stucture Learning.

View-Aware Geometry-Structure Joint Learning for Single-View 3D Shape Reconstruction

BAB-GSL: Using Bayesian influence with attention mechanism to optimize graph structure in basic views

Rethinking Structure Learning For Graph Neural Networks

Graph Structure Learning with Bi-level Optimization

Multi-View and Multi-Order Structured Graph Learning.

Compact Graph Structure Learning via Mutual Information Compression

GaGSL: Global-augmented Graph Structure Learning via Graph Information Bottleneck

Generic Structure Extraction with Bi-Level Optimization for Graph Structure Learning.

Hierarchical Multi-View Graph Pooling with Structure Learning

Semi-Supervised Graph Structure Learning via Dual Reinforcement of Label and Prior Structure

Structure-Aware Group Discrimination with Adaptive-View Graph Encoder: A Fast Graph Contrastive Learning Framework

A Survey on Graph Structure Learning: Progress and Opportunities

Towards Unsupervised Deep Graph Structure Learning

Multi-view feature selection via Nonnegative Structured Graph Learning

SE-GSL: A General and Effective Graph Structure Learning Framework Through Structural Entropy Optimization

Improving Subgraph Representation Learning via Multi-View Augmentation

Graph structure learning with variational information bottleneck

Node-like As a Whole: Structure-aware Searching and Coarsening for Graph Classification