Rethinking Fair Graph Neural Networks from Re-balancing

Zhixun Li,Yushun Dong,Qiang Liu,Jeffrey Xu Yu
2024-07-16
Abstract:Driven by the powerful representation ability of Graph Neural Networks (GNNs), plentiful GNN models have been widely deployed in many real-world applications. Nevertheless, due to distribution disparities between different demographic groups, fairness in high-stake decision-making systems is receiving increasing attention. Although lots of recent works devoted to improving the fairness of GNNs and achieved considerable success, they all require significant architectural changes or additional loss functions requiring more hyper-parameter tuning. Surprisingly, we find that simple re-balancing methods can easily match or surpass existing fair GNN methods. We claim that the imbalance across different demographic groups is a significant source of unfairness, resulting in imbalanced contributions from each group to the parameters updating. However, these simple re-balancing methods have their own shortcomings during training. In this paper, we propose FairGB, Fair Graph Neural Network via re-Balancing, which mitigates the unfairness of GNNs by group balancing. Technically, FairGB consists of two modules: counterfactual node mixup and contribution alignment loss. Firstly, we select counterfactual pairs across inter-domain and inter-class, and interpolate the ego-networks to generate new samples. Guided by analysis, we can reveal the debiasing mechanism of our model by the causal view and prove that our strategy can make sensitive attributes statistically independent from target labels. Secondly, we reweigh the contribution of each group according to gradients. By combining these two modules, they can mutually promote each other. Experimental results on benchmark datasets show that our method can achieve state-of-the-art results concerning both utility and fairness metrics. Code is available at <a class="link-external link-https" href="https://github.com/ZhixunLEE/FairGB" rel="external noopener nofollow">this https URL</a>.
Machine Learning,Artificial Intelligence,Computers and Society
What problem does this paper attempt to address?
### Problems Addressed by the Paper The paper primarily addresses the fairness issues in Graph Neural Networks (GNNs) when handling graph-structured data. Specifically: 1. **Fairness Issues**: Due to distribution differences among different demographic groups, existing GNN models may exhibit biases towards certain groups. For example, in loan approval processes, if historical data is biased towards individuals from high-income communities, the model may learn to associate high income with loan approval, thereby unfairly rejecting creditworthy applicants from low-income communities. 2. **Limitations of Existing Methods**: Although many works have aimed to improve the fairness of GNNs, these methods often require significant modifications to the model architecture or the introduction of additional loss functions, leading to complex hyperparameter tuning. This paper finds that simple rebalancing methods (such as resampling and reweighting) can easily achieve or even surpass the effectiveness of existing fair GNN methods without requiring additional hyperparameters. 3. **Imbalance Issues**: The imbalance among different demographic groups is a major source of unfairness, leading to unequal contributions of each group to the model parameter updates. While simple rebalancing methods are effective, they have some drawbacks during the training process. To address the above issues, the authors propose FairGB (Fair Graph Neural Networks via Rebalancing), which includes two modules: - **Counterfactual Node Mixing (CNM)**: Selects counterfactual sample pairs across domains and categories, and interpolates to generate new samples. - **Contribution Alignment Loss (CAL)**: Reweights the contributions of each group based on gradients to further enhance fairness. Experimental results show that FairGB achieves the best utility and fairness metrics on benchmark datasets.