Towards Responsible AI in Banking: Addressing Bias for Fair Decision-Making

Alessandro Castelnovo

2024-01-13

Abstract:In an era characterized by the pervasive integration of artificial intelligence into decision-making processes across diverse industries, the demand for trust has never been more pronounced. This thesis embarks on a comprehensive exploration of bias and fairness, with a particular emphasis on their ramifications within the banking sector, where AI-driven decisions bear substantial societal consequences. In this context, the seamless integration of fairness, explainability, and human oversight is of utmost importance, culminating in the establishment of what is commonly referred to as "Responsible AI". This emphasizes the critical nature of addressing biases within the development of a corporate culture that aligns seamlessly with both AI regulations and universal human rights standards, particularly in the realm of automated decision-making systems. Nowadays, embedding ethical principles into the development, training, and deployment of AI models is crucial for compliance with forthcoming European regulations and for promoting societal good. This thesis is structured around three fundamental pillars: understanding bias, mitigating bias, and accounting for bias. These contributions are validated through their practical application in real-world scenarios, in collaboration with Intesa Sanpaolo. This collaborative effort not only contributes to our understanding of fairness but also provides practical tools for the responsible implementation of AI-based decision-making systems. In line with open-source principles, we have released Bias On Demand and FairView as accessible Python packages, further promoting progress in the field of AI fairness.

Machine Learning,Computers and Society,Applications

What problem does this paper attempt to address?

The paper is primarily dedicated to addressing the issue of bias in artificial intelligence (AI) decision-making in the banking industry to achieve fair decision-making. Specifically, the research focuses on the following key aspects:

1. **Understanding Bias**: The paper introduces a framework called "Bias On Demand" for generating synthetic data with specific types of bias. This helps in understanding how bias is generated, how it manifests in data, and how it affects the decision outcomes of AI systems.

2. **Clarification of Fairness Metrics**: The paper also clarifies fairness metrics, particularly exploring the relationship between individual fairness and group fairness, as well as the connection between observational and causal standards. This analysis helps to reveal the complexity and interdependence of different fairness concepts.

3. **Mitigating Bias**: The paper proposes a toolkit named "BeFair," which includes a range of functionalities to achieve fairness in practical applications. These functionalities include detecting bias in input datasets and model outputs, mitigating bias using various strategies from existing literature, and evaluating performance using relevant metrics.

4. **Considering Bias**: The paper further proposes a structured roadmap aimed at addressing fairness issues in the banking industry. Additionally, it introduces a tool called "FairView" that supports users in selecting appropriate ethical frameworks when dealing with fairness. The research also explores fairness over time and develops an explainable AI-based approach to monitor this trend.

Through collaboration with Intesa Sanpaolo, these contributions not only deepen our understanding of fairness but also provide practical tools needed for implementing AI-based decision systems. These efforts follow open-source principles, aiming to advance the field of AI fairness.