Abstract:In cybersecurity applications where machine learning algorithms are increasingly used to detect vulnerabilities, a somewhat unique challenge arises as exploits targeting machine learning models are constantly devised by the attackers. Traditional machine learning models are no longer robust and reliable when they are under attack. The action and reaction between machine learning systems and the adversary can be modeled as a game between two or more players. Under well‐defined attack models, game theory can provide robustness guarantee for machine learning models that are otherwise vulnerable to application‐time data corruption. We review two cases of game theory‐based machine learning techniques: in one case, players play a zero sum game by following a minimax strategy, while in the other case, players play a sequential game with one player as the leader and the rest as the followers. Experimental results on e‐mail spam and web spam datasets are presented. In the zero sum game, we demonstrate that an adversarial SVM model built upon the minimax strategy is much more resilient to adversarial attacks than standard SVM and one‐class SVM models. We also show that optimal learning strategies derived to counter overly pessimistic attack models can produce unsatisfactory results when the real attacks are much weaker. In the sequential game, we demonstrate that the mixed strategy, allowing a player to randomize over available strategies, is the best solution in general without knowing what types of adversaries machine learning applications are facing in the wild. We also discuss scenarios where players' behavior may derail rational decision making and models that consider such decision risks.

Taxonomy and Recent Advance of Game Theoretical Approaches in Adversarial Machine Learning: A Survey

A Survey of Game Theoretic Approaches for Adversarial Machine Learning in Cybersecurity Tasks

Attacks in Adversarial Machine Learning: A Systematic Survey from the Life-cycle Perspective

Adversarial for Good – Defending Training Data Privacy with Adversarial Attack Wisdom

A Game Theoretic Perspective on Adversarial Machine Learning and Related Cybersecurity Applications

Defenses in Adversarial Machine Learning: A Survey

A survey of decision making in adversarial games

A Survey on Adversarial Machine Learning for Code Data: Realistic Threats, Countermeasures, and Interpretations

Adversarial Attacks and Defenses in Machine Learning-Powered Networks: A Contemporary Survey

A Survey of Adversarial Learning on Graphs

A reading survey on adversarial machine learning: Adversarial attacks and their understanding

Security Matters: A Survey on Adversarial Machine Learning

The Threat of Adversarial Attacks on Machine Learning in Network Security -- A Survey

Adversarial Training: A Survey

Adversarial Machine Learning on Social Network: A Survey

Recent Advances in Adversarial Training for Adversarial Robustness

Adversarial Attacks in Machine Learning: Key Insights and Defense Approaches

Adversarial Machine Learning Attacks against Intrusion Detection Systems: A Survey on Strategies and Defense

Adversarial attacks and defenses in explainable artificial intelligence: A survey

SoK: Adversarial Machine Learning Attacks and Defences in Multi-Agent Reinforcement Learning

Adversarial Machine Learning for Cybersecurity and Computer Vision: Current Developments and Challenges