Abstract:Graph Neural Networks (GNNs) have demonstrated great potential in achieving outstanding performance in various graph-related tasks, e.g., graph classification and link prediction. However, most of them suffer from the following issue: shallow networks capture very limited knowledge. Prior works design deep GNNs with more layers to solve the issue, which however introduces a new challenge, i.e., the infamous over-smoothness. Graph representation over emphasizes node features but only considers the static graph structure with a uniform weight are the key reasons for the over-smoothness issue. To alleviate the issue, this paper proposes a D ynamic W eighting S trategy (DWS) for addressing over-smoothness. We first employ Fuzzy C-Means (FCM) to cluster all nodes into several groups and get each node's fuzzy assignment, based on which a novel metric function is devised for dynamically adjusting the aggregation weights. This dynamic weighting strategy not only enables the intra-cluster interactions, but also inter-cluster aggregations, which well addresses undifferentiated aggregation caused by uniform weights. Based on DWS, we further design a S tructure A ugmentation (SA) step for addressing the issue of underutilizing the graph structure, where some potentially meaningful connections (i.e., edges) are added to the original graph structure via a parallelable KNN algorithm. In general, the optimized D ynamic W eighting S trategy with S tructure A ugmentation (DWSSA) alleviates over-smoothness by reducing noisy aggregations and utilizing topological knowledge. Extensive experiments on eleven homophilous or heterophilous graph benchmarks demonstrate the effectiveness of our proposed method DWSSA in alleviating over-smoothness and enhancing deep GNNs performance.

Resisting Over-Smoothing in Graph Neural Networks Via Dual-Dimensional Decoupling

Another Perspective of Over-Smoothing: Alleviating Semantic Over-Smoothing in Deep GNNs

Beyond smoothness: A general optimization framework for graph neural networks with negative Laplacian regularization

A Survey on Oversmoothing in Graph Neural Networks

Avoiding Oversmoothing in Deep Graph Neural Networks: A Multiplicative Ergodic Analysis

A Non-Asymptotic Analysis of Oversmoothing in Graph Neural Networks

ATNPA: A Unified View of Oversmoothing Alleviation in Graph Neural Networks

Measuring and Relieving the Over-Smoothing Problem for Graph Neural Networks from the Topological View

Residual Connections and Normalization Can Provably Prevent Oversmoothing in GNNs

DGNN: Decoupled Graph Neural Networks with Structural Consistency between Attribute and Graph Embedding Representations

Node Dependent Local Smoothing for Scalable Graph Learning

Decoupling the Depth and Scope of Graph Neural Networks

Enhancing Locally Adaptive Smoothing of Graph Neural Networks Via Laplacian Node Disagreement

Demystifying Oversmoothing in Attention-Based Graph Neural Networks

Limiting Over-Smoothing and Over-Squashing of Graph Message Passing by Deep Scattering Transforms

Difference Residual Graph Neural Networks

Graph Neural Networks Do Not Always Oversmooth

Tackling Over-Smoothing for General Graph Convolutional Networks

On the Trade-off between Over-smoothing and Over-squashing in Deep Graph Neural Networks

DWSSA: Alleviating over-smoothness for deep Graph Neural Networks