Abstract:Graph Neural Networks (GNNs) have demonstrated great potential in achieving outstanding performance in various graph-related tasks, e.g., graph classification and link prediction. However, most of them suffer from the following issue: shallow networks capture very limited knowledge. Prior works design deep GNNs with more layers to solve the issue, which however introduces a new challenge, i.e., the infamous over-smoothness. Graph representation over emphasizes node features but only considers the static graph structure with a uniform weight are the key reasons for the over-smoothness issue. To alleviate the issue, this paper proposes a D ynamic W eighting S trategy (DWS) for addressing over-smoothness. We first employ Fuzzy C-Means (FCM) to cluster all nodes into several groups and get each node's fuzzy assignment, based on which a novel metric function is devised for dynamically adjusting the aggregation weights. This dynamic weighting strategy not only enables the intra-cluster interactions, but also inter-cluster aggregations, which well addresses undifferentiated aggregation caused by uniform weights. Based on DWS, we further design a S tructure A ugmentation (SA) step for addressing the issue of underutilizing the graph structure, where some potentially meaningful connections (i.e., edges) are added to the original graph structure via a parallelable KNN algorithm. In general, the optimized D ynamic W eighting S trategy with S tructure A ugmentation (DWSSA) alleviates over-smoothness by reducing noisy aggregations and utilizing topological knowledge. Extensive experiments on eleven homophilous or heterophilous graph benchmarks demonstrate the effectiveness of our proposed method DWSSA in alleviating over-smoothness and enhancing deep GNNs performance.

Graph Size-imbalanced Learning with Energy-guided Structural Smoothing

On Size-Oriented Long-Tailed Graph Classification of Graph Neural Networks

When Imbalance Meets Imbalance: Structure-driven Learning for Imbalanced Graph Classification

Beyond smoothness: A general optimization framework for graph neural networks with negative Laplacian regularization

Adaptive Label Smoothing to Regularize Large-Scale Graph Training

Graph Structure Refinement with Energy-based Contrastive Learning

Structural Imbalance Aware Graph Augmentation Learning

Semi-supervised Node Classification Via Adaptive Graph Smoothing Networks

Node Dependent Local Smoothing for Scalable Graph Learning

Another Perspective of Over-Smoothing: Alleviating Semantic Over-Smoothing in Deep GNNs

Long Short-Term Graph Memory Against Class-imbalanced Over-smoothing

GraphSAGE++: Weighted Multi-scale GNN for Graph Representation Learning

Imbalanced Graph Classification with Multi-scale Oversampling Graph Neural Networks

Alleviating Over-Smoothing Via Graph Sparsification Based on Vertex Feature Similarity

DWSSA: Alleviating over-smoothness for deep Graph Neural Networks

UniGAP: A Universal and Adaptive Graph Upsampling Approach to Mitigate Over-Smoothing in Node Classification Tasks

Structure-Aware Label Smoothing for Graph Neural Networks

NAFS: A Simple Yet Tough-to-beat Baseline for Graph Representation Learning

Enhancing Size Generalization in Graph Neural Networks through Disentangled Representation Learning

Curriculum-Enhanced Residual Soft An-Isotropic Normalization for Over-smoothness in Deep GNNs