Abstract:Due to the vulnerability of deep neural networks (DNNs) to adversarial examples, a large number of defense techniques have been proposed to alleviate this problem in recent years. However, the progress of building more robust models is usually hampered by the incomplete or incorrect robustness evaluation. To accelerate the research on reliable evaluation of adversarial robustness of the current defense models in image classification, the TSAIL group at Tsinghua University and the Alibaba Security group organized this competition along with a CVPR 2021 workshop on adversarial machine learning (<a class="link-external link-https" href="https://aisecure-workshop.github.io/amlcvpr2021/" rel="external noopener nofollow">this https URL</a>). The purpose of this competition is to motivate novel attack algorithms to evaluate adversarial robustness more effectively and reliably. The participants were encouraged to develop stronger white-box attack algorithms to find the worst-case robustness of different defenses. This competition was conducted on an adversarial robustness evaluation platform -- ARES (<a class="link-external link-https" href="https://github.com/thu-ml/ares" rel="external noopener nofollow">this https URL</a>), and is held on the TianChi platform (<a class="link-external link-https" href="https://tianchi.aliyun.com/competition/entrance/531847/introduction" rel="external noopener nofollow">this https URL</a>) as one of the series of AI Security Challengers Program. After the competition, we summarized the results and established a new adversarial robustness benchmark at <a class="link-external link-https" href="https://ml.cs.tsinghua.edu.cn/ares-bench/" rel="external noopener nofollow">this https URL</a>, which allows users to upload adversarial attack algorithms and defense models for evaluation.

Adversarial Attacks and Defences Competition

Attack As Defense: Characterizing Adversarial Examples Using Robustness.

Adversarial Attacks on ML Defense Models Competition

Adversarial Attacks and Defenses Against Deep Neural Networks: A Survey

Adversarial Example Games

Unrestricted Adversarial Attacks on ImageNet Competition

Adversarial Examples: Attacks and Defenses for Deep Learning

Adversarial Examples on Object Recognition: A Comprehensive Survey

A Universal Defense Strategy Against Adversarial Attacks Based on Attention-Guided

Ensemble Adversarial Training: Attacks and Defenses

Towards Deep Learning Models Resistant to Adversarial Attacks

Adversarial Examples: Opportunities and Challenges

Adversarial examples for models of code

Adversarial Attack and Defense: A Survey

Adversarial examples: A survey of attacks and defenses in deep learning-enabled cybersecurity systems

Motivating the Rules of the Game for Adversarial Example Research

How Can We Deal with Adversarial Examples?

Adversarial Attacks and Defenses in Images, Graphs and Text: A Review

Adversarial machine learning in Network Intrusion Detection Systems