Abstract:Graph neural networks (GNNs) have achieved remarkable success in a variety of machine learning tasks over graph data. Existing GNNs usually rely on message passing, i.e., computing node representations by gathering information from the neighborhood, to build their underlying computational graphs. They are known fairly limited in expressive power, and often fail to capture global characteristics of graphs. To overcome the issue, a popular solution is to use Laplacian eigenvectors as additional node features, as they contain global positional information of nodes, and can serve as extra node identifiers aiding GNNs to separate structurally similar nodes. For such an approach, properly handling the orthogonal group symmetry among eigenvectors with equal eigenvalue is crucial for its stability and generalizability. However, using a naive orthogonal group invariant encoder for each separate eigenspace may not keep the full expressivity in the Laplacian eigenvectors. Moreover, computing such invariants inevitably entails a hard split of Laplacian eigenvalues according to their numerical identity, which suffers from great instability when the graph structure is perturbed. In this paper, we propose a novel method exploiting Laplacian eigenvectors to generate stable and globally expressive graph representations. The main difference from previous works is that (i) our method utilizes learnable orthogonal group invariant representations for each Laplacian eigenspace, based upon powerful orthogonal group equivariant neural network layers already well studied in the literature, and that (ii) our method deals with numerically close eigenvalues in a smooth fashion, ensuring its better robustness against perturbations. Experiments on various graph learning benchmarks witness the competitive performance of our method, especially its great potential to learn global properties of graphs.

LSEGNN: Encode Local Topology Structure in Graph Neural Networks

LoSS: Local Structural Separation Hypergraph Convolutional Neural Network

NGAT: Attention in Breadth and Depth Exploration for Semi-Supervised Graph Representation Learning

Local Clustering Graph Neural Networks

GraLSP: Graph Neural Networks with Local Structural Patterns

LSGNN: Towards General Graph Neural Network in Node Classification by Local Similarity

From Stars to Subgraphs: Uplifting Any GNN with Local Structure Awareness

Local Augmentation for Graph Neural Networks

Two-level Graph Neural Network

Learning graph-level representation from local-structural distribution with Graph Neural Networks

RSGNN: residual structure graph neural network

Local Structure-aware Graph Contrastive Representation Learning

Conditional Local Feature Encoding for Graph Neural Networks

Representation Learning of Enhanced Graphs Using Random Walk Graph Convolutional Network

Semi-Supervised Mixture Learning for Graph Neural Networks With Neighbor Dependence

Graph Neural Networks with Feature and Structure Aware Random Walk

Self-Attention Empowered Graph Convolutional Network for Structure Learning and Node Embedding

GAIN: Graph Attention & Interaction Network for Inductive Semi-Supervised Learning over Large-scale Graphs

Towards Stable, Globally Expressive Graph Representations with Laplacian Eigenvectors

DGNN: Decoupled Graph Neural Networks with Structural Consistency between Attribute and Graph Embedding Representations

LGNN: a novel linear graph neural network algorithm