Abstract:We propose gradient adversarial training, an auxiliary deep learning framework applicable to different machine learning problems. In gradient adversarial training, we leverage a prior belief that in many contexts, simultaneous gradient updates should be statistically indistinguishable from each other. We enforce this consistency using an auxiliary network that classifies the origin of the gradient tensor, and the main network serves as an adversary to the auxiliary network in addition to performing standard task-based training. We demonstrate gradient adversarial training for three different scenarios: (1) as a defense to adversarial examples we classify gradient tensors and tune them to be agnostic to the class of their corresponding example, (2) for knowledge distillation, we do binary classification of gradient tensors derived from the student or teacher network and tune the student gradient tensor to mimic the teacher's gradient tensor; and (3) for multi-task learning we classify the gradient tensors derived from different task loss functions and tune them to be statistically indistinguishable. For each of the three scenarios we show the potential of gradient adversarial training procedure. Specifically, gradient adversarial training increases the robustness of a network to adversarial attacks, is able to better distill the knowledge from a teacher network to a student network compared to soft targets, and boosts multi-task learning by aligning the gradient tensors derived from the task specific loss functions. Overall, our experiments demonstrate that gradient tensors contain latent information about whatever tasks are being trained, and can support diverse machine learning problems when intelligently guided through adversarialization using a auxiliary network.

Gradient Agreement Hinders the Memorization of Noisy Labels

FGCM: Noisy Label Learning via Fine-Grained Confidence Modeling

How does Disagreement Help Generalization against Label Corruption?

Co-teaching + : Towards Training of Robust Deep Networks with Noisy Labels

Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labels

Agreement or Disagreement in Noise-tolerant Mutual Learning?

Cross-Training Deep Neural Networks for Learning from Label Noise

Gradient Adversarial Training of Neural Networks

Limited Gradient Descent: Learning With Noisy Labels

Consensus Co-teaching for Dynamically Learning with Noisy Labels

Combating Noisy Labels by Agreement: A Joint Training Method with Co-Regularization

Learning from Noisy Labels Via Meta Credible Label Elicitation.

Three-teaching: A Three-Way Decision Framework to Handle Noisy Labels

Learning with Neighbor Consistency for Noisy Labels

Enhancing Robustness in Learning with Noisy Labels: an Asymmetric Co-Training Approach

Combating noisy labels by agreement: A joint training method with co-regularization

ALEX: Towards Effective Graph Transfer Learning with Noisy Labels

SIGUA: Forgetting May Make Learning with Noisy Labels More Robust

Pumpout: A Meta Approach for Robustly Training Deep Neural Networks with Noisy Labels.

Multi-Objective Interpolation Training for Robustness to Label Noise

Iterative Cross Learning on Noisy Labels