Abstract:Graph Neural Networks (GNNs) have achieved remarkable success in various graph-based learning tasks. While their performance is often attributed to the powerful neighborhood aggregation mechanism, recent studies suggest that other components such as non-linear layers may also significantly affecting how GNNs process the input graph data in the spectral domain. Such evidence challenges the prevalent opinion that neighborhood aggregation mechanisms dominate the behavioral characteristics of GNNs in the spectral domain. To demystify such a conflict, this paper introduces a comprehensive benchmark to measure and evaluate GNNs' capability in capturing and leveraging the information encoded in different frequency components of the input graph data. Specifically, we first conduct an exploratory study demonstrating that GNNs can flexibly yield outputs with diverse frequency components even when certain frequencies are absent or filtered out from the input graph data. We then formulate a novel research problem of measuring and benchmarking the performance of GNNs from a spectral perspective. To take an initial step towards a comprehensive benchmark, we design an evaluation protocol supported by comprehensive theoretical analysis. Finally, we introduce a comprehensive benchmark on real-world datasets, revealing insights that challenge prevalent opinions from a spectral perspective. We believe that our findings will open new avenues for future advancements in this area. Our implementations can be found at: <a class="link-external link-https" href="https://github.com/yushundong/Spectral-benchmark" rel="external noopener nofollow">this https URL</a>.

Understanding Spectral Graph Neural Network

A Survey on Spectral Graph Neural Networks

Graph Neural Networks Are More Than Filters: Revisiting and Benchmarking from A Spectral Perspective

How Powerful are Spectral Graph Neural Networks.

Understanding Graph Neural Networks from Graph Signal Denoising Perspectives

Benchmarking Spectral Graph Neural Networks: A Comprehensive Study on Effectiveness and Efficiency

Survey of Graph Neural Networks and Applications

Rethinking Spectral Augmentation for Contrast-based Graph Self-Supervised Learning

Spectral Graph Analysis: A Unified Explanation and Modern Perspectives

Octave Graph Convolutional Network

Spectral GNN via Two-dimensional (2-D) Graph Convolution

Graph Neural Networks with Diverse Spectral Filtering

An Experimental Study of the Transferability of Spectral Graph Networks

A Spectral Analysis of Graph Neural Networks on Dense and Sparse Graphs

An In-depth Analysis of Graph Neural Networks for Semi-supervised Learning

Spectral-based Graph Convolutional Network for Directed Graphs

Pointspectrum: Equivariance Meets Laplacian Filtering for Graph Representation Learning

Through the Dual-Prism: A Spectral Perspective on Graph Data Augmentation for Graph Classification

Foundations and Frontiers of Graph Learning Theory

Spectral Privacy Detection on Black-box Graph Neural Networks

Everything is Connected: Graph Neural Networks