Abstract:Deep neural networks (DNNs) often face challenges due to their vulnerability to various adversarial perturbations, including false perturbations that undermine prediction accuracy and biased perturbations that cause biased predictions for similar inputs. This paper introduces a novel approach, RobustFair, to evaluate the accurate fairness of DNNs when subjected to these false or biased perturbations. RobustFair employs the notion of the fairness confusion matrix induced in accurate fairness to identify the crucial input features for perturbations. This matrix categorizes predictions as true fair, true biased, false fair, and false biased, and the perturbations guided by it can produce a dual impact on instances and their similar counterparts to either undermine prediction accuracy (robustness) or cause biased predictions (individual fairness). RobustFair then infers the ground truth of these generated adversarial instances based on their loss function values approximated by the total derivative. To leverage the generated instances for trustworthiness improvement, RobustFair further proposes a data augmentation strategy to prioritize adversarial instances resembling the original training set, for data augmentation and model retraining. Notably, RobustFair excels at detecting intertwined issues of robustness and individual fairness, which are frequently overlooked in standard robustness and individual fairness evaluations. This capability empowers RobustFair to enhance both robustness and individual fairness evaluations by concurrently identifying defects in either domain. Empirical case studies and quantile regression analyses on benchmark datasets demonstrate the effectiveness of the fairness confusion matrix guided perturbation for false or biased adversarial instance generation.

To be Robust or to be Fair: Towards Fairness in Adversarial Training

Attack As Defense: Characterizing Adversarial Examples Using Robustness.

Improving Robust Fairness via Balance Adversarial Training

Towards Fairness-Aware Adversarial Learning

To be Robust and to be Fair: Aligning Fairness with Robustness

RobustFair: Adversarial Evaluation through Fairness Confusion Directed Gradient Search

How Robust is your Fair Model? Exploring the Robustness of Diverse Fairness Strategies

Improving Machine Learning Robustness via Adversarial Training

FaiR-N: Fair and Robust Neural Networks for Structured Data

Fairness-aware Regression Robust to Adversarial Attacks

Feature Augmentation for Adversarial Robustness

CFA: Class-wise Calibrated Fair Adversarial Training

Robust Local Features for Improving the Generalization of Adversarial Training

DAFA: Distance-Aware Fair Adversarial Training

FAIR-TAT: Improving Model Fairness Using Targeted Adversarial Training

Fairness via Adversarial Attribute Neighbourhood Robust Learning

Robustness, Privacy, and Generalization of Adversarial Training

Adversarial Training with Anti-adversaries

The Double-Edged Sword of Input Perturbations to Robust Accurate Fairness

On the Fairness ROAD: Robust Optimization for Adversarial Debiasing

Towards Robust Training of Neural Networks by Regularizing Adversarial Gradients