Abstract:Graph representation learning, aiming to learn low-dimensional representations which capture the geometric dependencies between nodes in the original graph, has gained increasing popularity in a variety of graph analysis tasks, including node classification and link prediction. Existing representation learning methods based on graph neural networks and their variants rely on the aggregation of neighborhood information, which makes it sensitive to noises in the graph. In this paper, we propose Graph Denoising Policy Network (short for GDPNet) to learn robust representations from noisy graph data through reinforcement learning. GDPNet first selects signal neighborhoods for each node, and then aggregates the information from the selected neighborhoods to learn node representations for the down-stream tasks. Specifically, in the signal neighborhood selection phase, GDPNet optimizes the neighborhood for each target node by formulating the process of removing noisy neighborhoods as a Markov decision process and learning a policy with task-specific rewards received from the representation learning phase. In the representation learning phase, GDPNet aggregates features from signal neighbors to generate node representations for down-stream tasks, and provides task-specific rewards to the signal neighbor selection phase. These two phases are jointly trained to select optimal sets of neighbors for target nodes with maximum cumulative task-specific rewards, and to learn robust representations for nodes. Experimental results on node classification task demonstrate the effectiveness of GDNet, outperforming the state-of-the-art graph representation learning methods on several well-studied datasets. Additionally, GDPNet is mathematically equivalent to solving the submodular maximizing problem, which theoretically guarantees the best approximation to the optimal solution with GDPNet.

NetRL: Task-aware Network Denoising via Deep Reinforcement Learning

Robust Network Enhancement from Flawed Networks.

Noise is the Fatal Poison: A Noise-aware Network for Noisy Dataset Classification

Finding critical edges in networks through deep reinforcement learning

PathNet: Path-Selective Point Cloud Denoising

LDN-RC: a Lightweight Denoising Network with Residual Connection to Improve Adversarial Robustness

Dilated Residual Encode-Decode Networks for Image Denoising

ANRL: Attributed Network Representation Learning Via Deep Neural Networks

You Can't Ignore Either: Unifying Structure and Feature Denoising for Robust Graph Learning

Learning Robust Representations with Graph Denoising Policy Network

NERNet: Noise Estimation and Removal Network for Image Denoising

Combating Bilateral Edge Noise for Robust Link Prediction

Graph Unrolling Networks: Interpretable Neural Networks for Graph Signal Denoising

NROWAN-DQN: A Stable Noisy Network with Noise Reduction and Online Weight Adjustment for Exploration

Enabling Robust DRL-Driven Networking Systems Via Teacher-Student Learning

Leveraging Domain Knowledge for Robust Deep Reinforcement Learning in Networking

RePCD-Net: Feature-Aware Recurrent Point Cloud Denoising Network

Reverse network diffusion to remove indirect noise for better inference of gene regulatory networks

R3L: Connecting Deep Reinforcement Learning to Recurrent Neural Networks for Image Denoising via Residual Recovery

Effect of network architectures in multi-agent reinforcement learning for denoising digital tomosynthesis images

Consolidation of Structure of High Noise Data by a New Noise Index and Reinforcement Learning.