Abstract:Graph neural networks (GNNs) have achieved remarkable success in a variety of machine learning tasks over graph data. Existing GNNs usually rely on message passing, i.e., computing node representations by gathering information from the neighborhood, to build their underlying computational graphs. They are known fairly limited in expressive power, and often fail to capture global characteristics of graphs. To overcome the issue, a popular solution is to use Laplacian eigenvectors as additional node features, as they contain global positional information of nodes, and can serve as extra node identifiers aiding GNNs to separate structurally similar nodes. For such an approach, properly handling the orthogonal group symmetry among eigenvectors with equal eigenvalue is crucial for its stability and generalizability. However, using a naive orthogonal group invariant encoder for each separate eigenspace may not keep the full expressivity in the Laplacian eigenvectors. Moreover, computing such invariants inevitably entails a hard split of Laplacian eigenvalues according to their numerical identity, which suffers from great instability when the graph structure is perturbed. In this paper, we propose a novel method exploiting Laplacian eigenvectors to generate stable and globally expressive graph representations. The main difference from previous works is that (i) our method utilizes learnable orthogonal group invariant representations for each Laplacian eigenspace, based upon powerful orthogonal group equivariant neural network layers already well studied in the literature, and that (ii) our method deals with numerically close eigenvalues in a smooth fashion, ensuring its better robustness against perturbations. Experiments on various graph learning benchmarks witness the competitive performance of our method, especially its great potential to learn global properties of graphs.

Quantifying inter-vertices correlation strength and its universal enhancement role in representation learning

Learning to Infer Unseen Single-/ Multi-Attribute-Object Compositions with Graph Networks.

Correlation of Centralities: A Study Through Distinct Graph Robustness

Asymmetric Transitivity Preserving Graph Embedding

A Measure of the Connection Strengths Between Graph Vertices with Applications

Vertex Centrality of Complex Networks Based on Joint Nonnegative Matrix Factorization and Graph Embedding

Multivariate Relations Aggregation Learning in Social Networks

GraRep++: Flexible Learning Graph Representations with Weighted Global Structural Information.

Graph Representation Learning Via Graphical Mutual Information Maximization.

Residual Correlation in Graph Neural Network Regression

Graphion: graph neural network-based visual correlation feature extraction module

Towards Stable, Globally Expressive Graph Representations with Laplacian Eigenvectors

Feature Correlation Aggregation: on the Path to Better Graph Neural Networks

Representation learning of in-degree-based digraph with rich information

Representation Learning Method of Graph Convolutional Network Based on Structure Enhancement

An Optimal Edge-weighted Graph Semantic Correlation Framework for Multi-view Feature Representation Learning

Precise influence evaluation in complex networks

Learning Relation Ties with a Force-Directed Graph in Distant Supervised Relation Extraction

Application of Graph Learning With Multivariate Relational Representation Matrix in Vehicular Social Networks

Network Representation Lightening from Hashing to Quantization

Dynamic Graph Transformer with Correlated Spatial-Temporal Positional Encoding