Abstract:Despite the essential need for comprehensive considerations in responsible AI, factors like robustness, fairness, and causality are often studied in isolation. Adversarial perturbation, used to identify vulnerabilities in models, and individual fairness, aiming for equitable treatment of similar individuals, despite initial differences, both depend on metrics to generate comparable input data instances. Previous attempts to define such joint metrics often lack general assumptions about data or structural causal models and were unable to reflect counterfactual proximity. To address this, our paper introduces a causal fair metric formulated based on causal structures encompassing sensitive attributes and protected causal perturbation. To enhance the practicality of our metric, we propose metric learning as a method for metric estimation and deployment in real-world problems in the absence of structural causal models. We also demonstrate the application of our novel metric in classifiers. Empirical evaluation of real-world and synthetic datasets illustrates the effectiveness of our proposed metric in achieving an accurate classifier with fairness, resilience to adversarial perturbations, and a nuanced understanding of causal relationships.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to comprehensively consider causality, individual fairness and adversarial robustness in the absence of a Structural Causal Model (SCM). Specifically, the paper aims to:
1. **Define causal fairness metric**: Propose a fairness metric (Causal Fair Metric) that can simultaneously reflect causal relationships and protect sensitive attributes, so as to ensure that similar individuals can be treated fairly when processing data and can resist adversarial attacks.
2. **Generate protected causal perturbations**: Use the proposed causal fairness metric to generate adversarial perturbations. Such perturbations not only consider causal relationships but also protect sensitive attributes, thereby improving the robustness and fairness of the model.
3. **Conduct metric learning without SCM**: Propose a metric learning method based on label - distance data, so that in practical applications, the causal fairness metric can be effectively learned without knowing the specific structure of the SCM.
### Specific problem background
- **Causality**: Causality refers to the causal dependence relationship between variables, which is usually represented by a Structural Causal Model (SCM). In machine learning, understanding causality helps to build more robust and interpretable models.
- **Individual fairness**: Individual fairness means that similar individuals should be treated similarly, avoiding discrimination due to individual characteristics (such as race, gender, etc.). Dwork et al. proposed a fairness definition based on Lipschitz continuity, but this definition requires an appropriate metric to evaluate the similarity between individuals.
- **Adversarial robustness**: Adversarial robustness refers to the stability of a model when facing small input perturbations. Goodfellow et al. proposed the concept of adversarial perturbations to test the vulnerability of the model. Traditional metric methods (such as Euclidean distance) have limitations when dealing with causal relationships.
### Main contributions of the paper
1. **Causal fairness metric**: The paper proposes a Causal Fair Metric, which not only considers causality but also protects sensitive attributes. The specific definitions are as follows:
- For all \( v\in V \) and \( s\in S \), the metric \( d(v,\tilde{v}_s) = 0 \), where \( \tilde{v}_s \) is the counterfactual twin instance of \( v \).
- \( d(v,\text{CF}(v,\delta)) \) is continuous with respect to the perturbation \( \delta \) of the non - sensitive part, that is, \( \text{CF}(v,\delta) \) represents the counterfactual instance after adding noise \( \delta \) to the non - sensitive part.
2. **Protected causal perturbations**: The paper defines a Protected Causal Perturbation Ball for generating adversarial perturbations. The specific definition is as follows:
\[
B_{\text{PCP}}^\Delta(v)=\{v'\in V:d(v,v')\leq\Delta\}
\]
where \( \Delta \) is a non - negative real number, representing the radius of the perturbation.
3. **Metric learning method**: The paper proposes a metric learning method based on label - distance data for estimating the causal fairness metric without SCM. Specific methods include Contrastive Learning and Triplet Learning.
### Experimental verification
The paper conducted experiments on synthetic datasets and real - world datasets to verify the effectiveness of the proposed causal fairness metric. The experimental results show that using the causal fairness metric can improve the fairness and robustness of the classifier and perform better under adversarial attacks.
### Conclusion
By introducing the causal fairness metric and protected causal perturbations, the paper successfully comprehensively considers causality, individual fairness and adversarial robustness in the absence of a Structural Causal Model.