ADEdgeDrop: Adversarial Edge Dropping for Robust Graph Neural Networks

Zhaoliang Chen,Zhihao Wu,Ylli Sadikaj,Claudia Plant,Hong-Ning Dai,Shiping Wang,Yiu-Ming Cheung,Wenzhong Guo

2024-08-14

Abstract:Although Graph Neural Networks (GNNs) have exhibited the powerful ability to gather graph-structured information from neighborhood nodes via various message-passing mechanisms, the performance of GNNs is limited by poor generalization and fragile robustness caused by noisy and redundant graph data. As a prominent solution, Graph Augmentation Learning (GAL) has recently received increasing attention. Among prior GAL approaches, edge-dropping methods that randomly remove edges from a graph during training are effective techniques to improve the robustness of GNNs. However, randomly dropping edges often results in bypassing critical edges, consequently weakening the effectiveness of message passing. In this paper, we propose a novel adversarial edge-dropping method (ADEdgeDrop) that leverages an adversarial edge predictor guiding the removal of edges, which can be flexibly incorporated into diverse GNN backbones. Employing an adversarial training framework, the edge predictor utilizes the line graph transformed from the original graph to estimate the edges to be dropped, which improves the interpretability of the edge-dropping method. The proposed ADEdgeDrop is optimized alternately by stochastic gradient descent and projected gradient descent. Comprehensive experiments on six graph benchmark datasets demonstrate that the proposed ADEdgeDrop outperforms state-of-the-art baselines across various GNN backbones, demonstrating improved generalization and robustness.

Machine Learning,Artificial Intelligence

What problem does this paper attempt to address?

### Problems Addressed by the Paper

The paper aims to address the issues of generalization and robustness that Graph Neural Networks (GNNs) face when dealing with noisy and redundant data. Specifically:

1. **Problems with Existing Methods**: Current random edge deletion methods can improve the robustness of GNNs but often overlook critical edges, thereby weakening the effectiveness of message passing.

2. **Proposed Method**: The paper introduces a new adversarial edge deletion method (ADEdgeDrop), which guides the edge deletion process through an adversarial training framework. This method uses edge embeddings in a line graph (converted from the original graph) to estimate which edges should be deleted, thereby retaining key connections and removing unimportant edges.

3. **Advantages**:
- **Semantic Interpretability**: By supervising the edge deletion process with a line graph, it better captures the relationships between the original edges.
- **Robustness and Generalization**: Through adversarial training, it mitigates overfitting effects and enhances the model's robustness and generalization capabilities.

### Summary

The paper proposes a new adversarial edge deletion method, ADEdgeDrop, to address the shortcomings of existing random edge deletion methods. The goal is to enhance the robustness and generalization capabilities of GNNs through a more effective edge deletion strategy. Experimental results show that this method outperforms existing methods on multiple benchmark datasets.