Learning a Fair and Privacy-Preserving Graph Neural Network from Private and Limited Sensitive Attributes

Xuemin Wang,Tianlong Gu,xuguang bao,Liang Chang

DOI: https://doi.org/10.36227/techrxiv.23812209

2023-01-01

Abstract:Learning a fair and privacy-preserving graph neural network from private and limited sensitive attributes

What problem does this paper attempt to address?

Devil in Disguise: Breaching Graph Neural Networks Privacy through Infiltration

Lingshuo Meng,Yijie Bai,Yanjiao Chen,Yutong Hu,Wenyuan Xu,Haiqin Weng

DOI: https://doi.org/10.1145/3576915.3623173

2023-01-01

Abstract:Graph neural networks (GNNs) have been developed to mine useful information from graph data of various applications, e.g., health-care, fraud detection, and social recommendation. However, GNNs open up new attack surfaces for privacy attacks on graph data. In this paper, we propose Infiltrator, a privacy attack that is able to pry node-level private information based on black-box access to GNNs. Different from existing works that require prior information of the victim node, we explore the possibility of conducting the attack without any information of the victim node. Our idea is to infiltrate the graph with attacker-created nodes to befriend the victim node. More specifically, we design infiltration schemes that enable the adversary to infer the label, neighboring links, and sensitive attributes of a victim node. We evaluate Infiltrator with extensive experiments on three representative GNN models and six real-world datasets. The results demonstrate that Infiltrator can achieve an attack performance of more than 98% in all three attacks, outperforming baseline approaches. We further evaluate the defense resistance of Infiltrator against the graph homophily defender and the differentially private model.
Fair and Privacy-Preserving Graph Neural Network.

Xuemin Wang,Tianlong Gu,Xuguang Bao,Liang Chang

DOI: https://doi.org/10.1007/978-3-031-30678-5_64

2023-01-01

Abstract:Graph neural networks (GNNs) have demonstrated superior performance in modeling graph-structured. They are vastly applied in various high-stakes scenarios such as financial analysis and social analysis. Among the fields, privacy issues and fairness issues have become the focus of attention. Currently, most studies focus on protecting data privacy or promoting the fairness of the model. However, how to both guarantee privacy and fairness is under-explored on GNN. To ensure GNNs behave in a socially responsible manner, it is necessary to protect the privacy and mitigate bias simultaneously. Therefore, our Ph.D. project aims at creating GNNs which can promote fairness and protect data privacy, preserving high utility performance.
Individual Fairness for Local Private Graph Neural Network

Xuemin Wang,Tianlong Gu,Xuguang Bao,Liang Chang,Long Li

DOI: https://doi.org/10.1016/j.knosys.2023.110490

IF: 8.139

2023-01-01

Knowledge-Based Systems

Abstract:Graph neural networks (GNNs) have shown superior performance in learning node representation for various graph inference tasks and play a pivotal role in high-stakes decision scenarios. However, GNNs may magnify the bias in the original data and make discriminatory decisions toward individuals, reducing user trust. Some research advances have been made to improve the individual fairness of GNNs and increase trust. However, they raise privacy issues when the acquired data involves sensitive information. To address this challenge, we propose a GNN privacy protection method called local private feature-individual fairness graph neural network, LPF-IFGNN for node features based on local differential privacy (LDP) that can strike a balance between fairness and privacy. Specially, we propose an LDP mechanism that considers privacy issues in normalization and can compress and perturb features. In addition, we employ a convolution layer that aggregates multi-hop node features using the mean function to denoise and avoid promoting individual fairness about the perturbed features. We consider the situation where node labels are also required to be protected, and we further propose LPL-LPF-IFGNN based on LDP. Experimental results on five real-world datasets show that LPL-LPF-IFGNN outperforms the state-of-the-art fairness baseline by 41.75% on ACC and 5.02% on NDCG@10 on private data with a feature privacy budget of 1 and a label privacy budget of 0.5. Experiments further indicate that our methods can achieve a good balance between model utility and individual fairness for private node data with LDP guarantees.
One Fits All: Learning Fair Graph Neural Networks for Various Sensitive Attributes

Yuchang Zhu,Jintang Li,Yatao Bian,Zibin Zheng,Liang Chen

2024-07-03

Abstract:Recent studies have highlighted fairness issues in Graph Neural Networks (GNNs), where they produce discriminatory predictions against specific protected groups categorized by sensitive attributes such as race and age. While various efforts to enhance GNN fairness have made significant progress, these approaches are often tailored to specific sensitive attributes. Consequently, they necessitate retraining the model from scratch to accommodate changes in the sensitive attribute requirement, resulting in high computational costs. To gain deeper insights into this issue, we approach the graph fairness problem from a causal modeling perspective, where we identify the confounding effect induced by the sensitive attribute as the underlying reason. Motivated by this observation, we formulate the fairness problem in graphs from an invariant learning perspective, which aims to learn invariant representations across environments. Accordingly, we propose a graph fairness framework based on invariant learning, namely FairINV, which enables the training of fair GNNs to accommodate various sensitive attributes within a single training session. Specifically, FairINV incorporates sensitive attribute partition and trains fair GNNs by eliminating spurious correlations between the label and various sensitive attributes. Experimental results on several real-world datasets demonstrate that FairINV significantly outperforms state-of-the-art fairness approaches, underscoring its effectiveness. Our code is available via: <a class="link-external link-https" href="https://github.com/ZzoomD/FairINV/" rel="external noopener nofollow">this https URL</a>.

Machine Learning
A Privacy Preserving Graph Neural Networks Framework by Protecting User’s Attributes

Li Zhou,Jing Wang,Dongmei Fan,Haifeng Zhang,Kai Zhong

DOI: https://doi.org/10.1016/j.physa.2023.129187

IF: 3.778

2023-01-01

Physica A Statistical Mechanics and its Applications

Abstract:Graph neural networks (GNNs) can learn the node representations to capture both node features and graph topology information through the message passing mechanism. However, since the information collected by GNNs is often used without authorization or maliciously attacked by hackers, which may result in leakage of users’ private information. To this end, we propose a privacy preserving GNNs framework, which not only protects the attribute privacy but also performs well in various downstream tasks. Specifically, when the users communicate with the third party, Paillier homomorphic encryption (HE) is used to encrypt users’ sensitive attribute information to prevent privacy leakage. Considering that the third party may be untrustworthy, differential privacy (DP) with Laplace mechanism is carried out to add noise to sensitive attribute information before transmission, so that the real attribute information is not accessible to the third party. Subsequently, the third party trains the GNNs model by using both the privacy preserving attribute information and public network topology information. Extensive experimental results show that, compared with the state-of-the-art methods, the privacy preserving GNNs still achieves satisfactory performance regarding different downstream tasks, such as node classification and link prediction while protecting the sensitive attributes of individuals.
Improving Fairness in Graph Neural Networks via Mitigating Sensitive Attribute Leakage

Yu Wang,Yuying Zhao,Yushun Dong,Huiyuan Chen,Jundong Li,Tyler Derr

DOI: https://doi.org/10.48550/arXiv.2206.03426

IF: 5.414

2022-06-07

Machine Learning

Abstract:Graph Neural Networks (GNNs) have shown great power in learning node representations on graphs. However, they may inherit historical prejudices from training data, leading to discriminatory bias in predictions. Although some work has developed fair GNNs, most of them directly borrow fair representation learning techniques from non-graph domains without considering the potential problem of sensitive attribute leakage caused by feature propagation in GNNs. However, we empirically observe that feature propagation could vary the correlation of previously innocuous non-sensitive features to the sensitive ones. This can be viewed as a leakage of sensitive information which could further exacerbate discrimination in predictions. Thus, we design two feature masking strategies according to feature correlations to highlight the importance of considering feature propagation and correlation variation in alleviating discrimination. Motivated by our analysis, we propose Fair View Graph Neural Network (FairVGNN) to generate fair views of features by automatically identifying and masking sensitive-correlated features considering correlation variation after feature propagation. Given the learned fair views, we adaptively clamp weights of the encoder to avoid using sensitive-related features. Experiments on real-world datasets demonstrate that FairVGNN enjoys a better trade-off between model utility and fairness. Our code is publicly available at https://github.com/YuWVandy/FairVGNN.
Inferring Private Attributes Based on Graph Convolutional Neural Network in Social Networks

Yupan Tian,Yang Niu,Jun Yan,Feng Tian

DOI: https://doi.org/10.1109/nana.2019.00041

2019-01-01

Abstract:Machine Learning (ML) brings new challenges to Online Social Network (OSN) privacy preserving. Although privacy control access operation of OSN can avoid privacy disclosure in a certain extent, it still can't prevent ML-based inference attacks. Previous inference methods have shown that user hidden attributes can be reliably predicted from released OSN datasets, but there are limitations in the implementation of complex large-scale social networks. To effectively perform multi-attributes' feature learning and increase the inference accuracy, we present a private attributes inference approach based on Graph Convolutional Neural Networks for inferring attributes of social users. Our method leverages visible user profiles and social links to predict missing attributes of the target users in the published online social network datasets and it can be used to any large-scale graph-based networks. We experimentally proved that our approach can correctly infer private attributes with high probability.
Towards Fair Graph Neural Networks via Graph Counterfactual without Sensitive Attributes

Xuemin Wang,Tianlong Gu,Xuguang Bao,Liang Chang

2024-12-13

Abstract:Graph-structured data is ubiquitous in today's connected world, driving extensive research in graph analysis. Graph Neural Networks (GNNs) have shown great success in this field, leading to growing interest in developing fair GNNs for critical applications. However, most existing fair GNNs focus on statistical fairness notions, which may be insufficient when dealing with statistical anomalies. Hence, motivated by causal theory, there has been growing attention to mitigating root causes of unfairness utilizing graph counterfactuals. Unfortunately, existing methods for generating graph counterfactuals invariably require the sensitive attribute. Nevertheless, in many real-world applications, it is usually infeasible to obtain sensitive attributes due to privacy or legal issues, which challenge existing methods. In this paper, we propose a framework named Fairwos (improving Fairness without sensitive attributes). In particular, we first propose a mechanism to generate pseudo-sensitive attributes to remedy the problem of missing sensitive attributes, and then design a strategy for finding graph counterfactuals from the real dataset. To train fair GNNs, we propose a method to ensure that the embeddings from the original data are consistent with those from the graph counterfactuals, and dynamically adjust the weight of each pseudo-sensitive attribute to balance its contribution to fairness and utility. Furthermore, we theoretically demonstrate that minimizing the relation between these pseudo-sensitive attributes and the prediction can enable the fairness of GNNs. Experimental results on six real-world datasets show that our approach outperforms state-of-the-art methods in balancing utility and fairness.

Machine Learning
Fair Graph Representation Learning Via Sensitive Attribute Disentanglement

Yuchang Zhu,Jintang Li,Zibin Zheng,Liang Chen

DOI: https://doi.org/10.1145/3589334.3645532

2024-01-01

Abstract:Group fairness for Graph Neural Networks (GNNs), which emphasizes algorithmicdecisions neither favoring nor harming certain groups defined by sensitiveattributes (e.g., race and gender), has gained considerable attention. Inparticular, the objective of group fairness is to ensure that the decisionsmade by GNNs are independent of the sensitive attribute. To achieve thisobjective, most existing approaches involve eliminating sensitive attributeinformation in node representations or algorithmic decisions. However, suchways may also eliminate task-related information due to its inherentcorrelation with the sensitive attribute, leading to a sacrifice in utility. Inthis work, we focus on improving the fairness of GNNs while preservingtask-related information and propose a fair GNN framework named FairSAD.Instead of eliminating sensitive attribute information, FairSAD enhances thefairness of GNNs via Sensitive Attribute Disentanglement (SAD), which separatesthe sensitive attribute-related information into an independent component tomitigate its impact. Additionally, FairSAD utilizes a channel masking mechanismto adaptively identify the sensitive attribute-related component andsubsequently decorrelates it. Overall, FairSAD minimizes the impact of thesensitive attribute on GNN outcomes rather than eliminating sensitiveattributes, thereby preserving task-related information associated with thesensitive attribute. Furthermore, experiments conducted on several real-worlddatasets demonstrate that FairSAD outperforms other state-of-the-art methods bya significant margin in terms of both fairness and utility performance. Oursource code is available at https://github.com/ZzoomD/FairSAD.
Privacy-Enhanced Graph Neural Network for Decentralized Local Graphs

Xinjun Pei,Xiaoheng Deng,Shengwei Tian,Jianqing Liu,Kaiping Xue

DOI: https://doi.org/10.1109/tifs.2023.3329971

IF: 7.231

2024-01-01

IEEE Transactions on Information Forensics and Security

Abstract:With the ever-growing interest in modeling complex graph structures, graph neural networks (GNN) provide a generalized form of exploiting non-Euclidean space data. However, the global graph may be distributed across multiple data centers, which makes conventional graph-based models incapable of modeling a complete graph structure. This also brings an unprecedented challenge to user privacy protection in distributed graph learning. Due to privacy requirements of legal policies, existing graph-based solutions are difficult to deploy in practice. In this paper, we propose a privacy-preserving graph neural network based on local graph augmentation, named LGA-PGNN, which preserves user privacy by enforcing local differential privacy (LDP) noise into the decentralized local graphs held by different data holders. Moreover, we perform local neighborhood augmentation on low-degree vertices to enhance the expressiveness of the learned model. Specifically, we propose two graph privacy attacks, namely attribute inference attack and link stealing attack, which aim at compromising user privacy. The experimental results demonstrate that LGA-PGNN can effectively mitigate these two attacks and provably avoid potential privacy leakage while ensuring the utility of the learning model.
Efficient Privacy Preserving Graph Neural Network for Node Classification

Xinjun Pei,Xiaoheng Deng,Shengwei Tian,Kaiping Xue

DOI: https://doi.org/10.1109/icassp49357.2023.10096911

2023-01-01

Abstract:Graph Neural Networks (GNNs) as an emerging technique have shown excellent performance in a variety of fields, such as social networks and recommendation systems. However, GNNs may have to overcome privacy concerns as large amounts of information about their training datasets may be compromised. In this paper, we develop a privacy-preserving GNN to enforce privacy preservation, which utilizes a private Functional Mechanism (FM) to train the learning model. This mechanism perturbs the polynomial approximation of the objective function to enforce Differential Privacy (DP) in the GNN model. We show that our method can maximize the accuracy of the results with comparable prediction power to the unperturbed results while satisfying the privacy guarantees.
Achieving Adaptive Privacy-Preserving Graph Neural Networks Training in Cloud Environment

Yanli Yuan,Dian Lei,Qing Fan,Keli Zhao,Liehuang Zhu,Chuan Zhang

DOI: https://doi.org/10.1109/icicn62625.2024.10761771

2024-01-01

Abstract:With the widespread adoption of Graph Neural Network (GNN) technology in industry, concerns regarding graph data privacy have become increasingly prominent. Differential privacy has been demonstrated as an effective method to ensure privacy in graph learning. However, existing differential privacy-based GNN methods often overlook the individual privacy protection needs of users, offering uniform privacy guarantees to all. This approach can result in either over-protection or insufficient protection for certain users. To address this issue, we propose an adaptive privacy-preserving GNN training method that accommodates the varying privacy requirements of nodes while achieving high model training accuracy. Specifically, APPGNN allocates adaptive privacy budgets based on individual user privacy needs. Additionally, to mitigate the impact of noise on data utility, APPGNN incorporates a weighted neighborhood aggregation mechanism to enhance GNN model accuracy. Theoretical analysis indicates that APPGNN provides adaptive privacy protection while ensuring ε-differential privacy on node data. Experimental evaluations on four real-world graph datasets validate the effectiveness of APPGNN.
Unraveling Privacy Risks of Individual Fairness in Graph Neural Networks

He Zhang,Xingliang Yuan,Shirui Pan

2024-03-20

Abstract:Graph neural networks (GNNs) have gained significant attraction due to their expansive real-world applications. To build trustworthy GNNs, two aspects - fairness and privacy - have emerged as critical considerations. Previous studies have separately examined the fairness and privacy aspects of GNNs, revealing their trade-off with GNN performance. Yet, the interplay between these two aspects remains unexplored. In this paper, we pioneer the exploration of the interaction between the privacy risks of edge leakage and the individual fairness of a GNN. Our theoretical analysis unravels that edge privacy risks unfortunately escalate when the nodes' individual fairness improves. Such an issue hinders the accomplishment of privacy and fairness of GNNs at the same time. To balance fairness and privacy, we carefully introduce fairness-aware loss reweighting based on influence function and privacy-aware graph structure perturbation modules within a fine-tuning mechanism. Experimental results underscore the effectiveness of our approach in achieving GNN fairness with limited performance compromise and controlled privacy risks. This work contributes to the comprehensively developing trustworthy GNNs by simultaneously addressing both fairness and privacy aspects.

Machine Learning,Computers and Society
Local Differential Privacy in Graph Neural Networks: a Reconstruction Approach

Karuna Bhaila,Wen Huang,Yongkai Wu,Xintao Wu

2024-08-06

Abstract:Graph Neural Networks have achieved tremendous success in modeling complex graph data in a variety of applications. However, there are limited studies investigating privacy protection in GNNs. In this work, we propose a learning framework that can provide node privacy at the user level, while incurring low utility loss. We focus on a decentralized notion of Differential Privacy, namely Local Differential Privacy, and apply randomization mechanisms to perturb both feature and label data at the node level before the data is collected by a central server for model training. Specifically, we investigate the application of randomization mechanisms in high-dimensional feature settings and propose an LDP protocol with strict privacy guarantees. Based on frequency estimation in statistical analysis of randomized data, we develop reconstruction methods to approximate features and labels from perturbed data. We also formulate this learning framework to utilize frequency estimates of graph clusters to supervise the training procedure at a sub-graph level. Extensive experiments on real-world and semi-synthetic datasets demonstrate the validity of our proposed model.

Machine Learning,Cryptography and Security
Releasing Graph Neural Networks with Differential Privacy Guarantees

Iyiola E. Olatunji,Thorben Funke,Megha Khosla

DOI: https://doi.org/10.48550/arXiv.2109.08907

2023-11-02

Abstract:With the increasing popularity of graph neural networks (GNNs) in several sensitive applications like healthcare and medicine, concerns have been raised over the privacy aspects of trained GNNs. More notably, GNNs are vulnerable to privacy attacks, such as membership inference attacks, even if only black-box access to the trained model is granted. We propose PrivGNN, a privacy-preserving framework for releasing GNN models in a centralized setting. Assuming an access to a public unlabeled graph, PrivGNN provides a framework to release GNN models trained explicitly on public data along with knowledge obtained from the private data in a privacy preserving manner. PrivGNN combines the knowledge-distillation framework with the two noise mechanisms, random subsampling, and noisy labeling, to ensure rigorous privacy guarantees. We theoretically analyze our approach in the Renyi differential privacy framework. Besides, we show the solid experimental performance of our method compared to several baselines adapted for graph-structured data. Our code is available at <a class="link-external link-https" href="https://github.com/iyempissy/privGnn" rel="external noopener nofollow">this https URL</a>.

Machine Learning,Cryptography and Security
Privacy-Preserving Decentralized Inference with Graph Neural Networks in Wireless Networks

Mengyuan Lee,Guanding Yu,Huaiyu Dai

DOI: https://doi.org/10.1109/twc.2023.3279442

IF: 10.4

2024-01-01

IEEE Transactions on Wireless Communications

Abstract:As an efficient neural network model for graph data, graph neural networks (GNNs) recently find successful applications for various wireless optimization problems. Given that the inference stage of GNNs can be naturally implemented in a decentralized manner, GNN is a potential enabler for decentralized control/management in the next-generation wireless communications. Privacy leakage, however, may occur due to the information exchanges among neighbors during decentralized inference with GNNs. To deal with this issue, in this paper, we analyze and enhance the privacy of decentralized inference with GNNs in wireless networks. Specifically, we adopt local differential privacy as the metric, and design novel privacy-preserving signals as well as privacy-guaranteed training algorithms to achieve privacy-preserving inference. We also define the SNR-privacy trade-off function to analyze the performance upper bound of decentralized inference with GNNs in wireless networks. To further enhance the communication and computation efficiency, we adopt the over-the-air computation technique and theoretically demonstrate its advantage in privacy preservation. Through extensive simulations on the synthetic graph data, we validate our theoretical analysis, verify the effectiveness of proposed privacy-preserving wireless signaling and privacy-guaranteed training algorithm, and offer some guidance on practical implementation.
P$$^2$$CG: a Privacy Preserving Collaborative Graph Neural Network Training Framework

Xupeng Miao,Wentao Zhang,Yuezihan Jiang,Fangcheng Fu,Yingxia Shao,Lei Chen,Yangyu Tao,Gang Cao,Bin Cui

DOI: https://doi.org/10.1007/s00778-022-00768-8

2022-01-01

Abstract:Graph neural networks (GNNs) and their variants have generalized deep learning methods into non-Euclidean graph data, bringing substantial improvement in many graph mining tasks. In practice, the large graph could be isolated by different databases. Recently, user privacy protection has become a crucial concern in practical machine learning, which motivates us to explore a GNN framework with data sharing and without violating user privacy leakage in the meanwhile. However, it is challenging to scale GNN training to edge partitioned distributed graph databases while preserving data privacy and model quality. In this paper, we propose a privacy preserving collaborative GNN training framework, P ^2 CG, aiming to obtain competitive model performance as the centralized setting. We present the clustering-based differential privacy algorithm to reduce the model degradation caused by the noisy edges generation. Moreover, we propose a novel interaction-based secure multi-layer graph convolution algorithm to alleviate the noise diffusion problem. Experimental results on the benchmark datasets and the production dataset in Tencent Inc. show that P ^2 CG can significantly increase the model performance and obtain competitive results as a centralized setting.
Towards Private Learning on Decentralized Graphs With Local Differential Privacy

Wanyu Lin,Baochun Li,Cong Wang

DOI: https://doi.org/10.1109/tifs.2022.3198283

IF: 7.231

2022-09-03

IEEE Transactions on Information Forensics and Security

Abstract:Many real-world networks are inherently decentralized. For example, in social networks, each user maintains a local view of a social graph, such as a list of friends and her profile. It is typical to collect these local views of social graphs and conduct graph learning tasks. However, learning over graphs can raise privacy concerns as these local views often contain sensitive information. In this paper, we seek to ensure private graph learning on a decentralized network graph. Towards this objective, we propose Solitude, a new privacy-preserving learning framework based on graph neural networks (GNNs), with formal privacy guarantees based on edge local differential privacy. The crux of Solitude is a set of new delicate mechanisms that can calibrate the introduced noise in the decentralized graph collected from the users. The principle behind the calibration is the intrinsic properties shared by many real-world graphs, such as sparsity. Unlike existing work on locally private GNNs, our new framework can simultaneously protect node feature privacy and edge privacy, and can seamlessly incorporate with any GNN with privacy-utility guarantees. Extensive experiments on benchmarking datasets show that Solitude can retain the generalization capability of the learned GNN while preserving the users' data privacy under given privacy budgets.

computer science, theory & methods,engineering, electrical & electronic
A Privacy-Preserving Graph Neural Network for Network Intrusion Detection

Xinjun Pei,Xiaoheng Deng,Shengwei Tian,Ping Jiang,Yunlong Zhao,Kaiping Xue

DOI: https://doi.org/10.1109/tdsc.2024.3417853

2024-01-01

IEEE Transactions on Dependable and Secure Computing

Abstract:With the ever-growing attention on communication security, machine learning-based network intrusion detection system (NIDS) is widely utilized to meet different security requirements. However, most of the existing methods manually extract or learn features from raw traffic, which is usually expensive, complicated, and time-consuming. Moreover, this also brings unprecedented challenges for preserving users' privacy in the communication process, making it difficult for existing solutions to be deployed in practice due to the privacy requirements from legal policies. This paper proposes a privacypreserving graph neural network (named NIGNN) for NIDS, which can encode the local structure and traffic features. To address the privacy issues pertaining to the application of graph representation learning, we design a privacy message-passing mechanism with formal privacy guarantees, in which sensitive information potentially contained in graph vertices will be kept private. Specifically, we design a privacy-enhancement graph representation that introduces a degree-sensitive item in vertexbased aggregation to reduce noise. Our theoretical analysis shows that NIGNN can provide a provable privacy guarantee. Extensive experiments demonstrate NIGNN's performance in maintaining a sound privacy-accuracy trade-off.
Disentangled Counterfactual Graph Augmentation Framework for Fair Graph Learning with Information Bottleneck

Lijing Zheng,Jihong Wang,Huan Liu,Minnan Luo

DOI: https://doi.org/10.1007/978-3-031-70341-6_23

2024-01-01

Abstract:Graph Neural Networks (GNNs) are susceptible to inheriting and even amplifying biases within datasets, subsequently leading to discriminatory decision-making. Our empirical observation reveals that the inconsistent distribution of sensitive attributes conditioned on labels significantly contributes to unfairness. To mitigate this problem, we suggest rectifying this inconsistency of the original dataset through a counterfactual augmentation strategy. Existing methods usually generate counterfactual samples from an entangled representation space, which fail to distinguish the different dependencies on sensitive attributes. Thus, we propose a novel disentangled counterfactual graph augmentation method based on the Information Bottleneck theory, named Fair Disentangled Graph Information Bottleneck (FDGIB). Specifically, FDGIB embeds graphs into two disentangled representation spaces: sensitive-related and sensitive-independent. By satisfying three conditions, FDGIB theoretically guarantees the disentanglement of different sensitive dependencies. We acquire credible counterfactual augmented graphs to facilitate consistency in data distribution and generate fair representations. FDGIB serves as a plug-and-play preprocessing framework that can collaborate with any GNNs. We validate the effectiveness of our model in promoting fairness learning through extensive experiments. Our source code is available at https://github.com/Evanlyf/FDGIB.

Learning a Fair and Privacy-Preserving Graph Neural Network from Private and Limited Sensitive Attributes

Devil in Disguise: Breaching Graph Neural Networks Privacy through Infiltration

Fair and Privacy-Preserving Graph Neural Network.

Individual Fairness for Local Private Graph Neural Network

One Fits All: Learning Fair Graph Neural Networks for Various Sensitive Attributes

A Privacy Preserving Graph Neural Networks Framework by Protecting User’s Attributes

Improving Fairness in Graph Neural Networks via Mitigating Sensitive Attribute Leakage

Inferring Private Attributes Based on Graph Convolutional Neural Network in Social Networks

Towards Fair Graph Neural Networks via Graph Counterfactual without Sensitive Attributes

Fair Graph Representation Learning Via Sensitive Attribute Disentanglement

Privacy-Enhanced Graph Neural Network for Decentralized Local Graphs

Efficient Privacy Preserving Graph Neural Network for Node Classification

Achieving Adaptive Privacy-Preserving Graph Neural Networks Training in Cloud Environment

Unraveling Privacy Risks of Individual Fairness in Graph Neural Networks

Local Differential Privacy in Graph Neural Networks: a Reconstruction Approach

Releasing Graph Neural Networks with Differential Privacy Guarantees

Privacy-Preserving Decentralized Inference with Graph Neural Networks in Wireless Networks

P$$^2$$CG: a Privacy Preserving Collaborative Graph Neural Network Training Framework

Towards Private Learning on Decentralized Graphs With Local Differential Privacy

A Privacy-Preserving Graph Neural Network for Network Intrusion Detection

Disentangled Counterfactual Graph Augmentation Framework for Fair Graph Learning with Information Bottleneck