Abstract:Abstract In the current European debate on the regulation of Artificial Intelligence there is a consensus that Artificial Intelligence (AI) systems should be fair. However, the multitude of existing indicators allowing an AI system to be labeled as “(un)fair” and the lack of standardized, application field specific criteria to choose among the various fairness-evaluation methods makes it difficult for potential auditors to arrive at a final, consistent judgment. Focusing on a concrete use case in the application field of finance, the main goal of this paper is to define standardizable minimal ethical requirements for AI fairness-evaluation. For the applied case of creditworthiness assessment for small personal loans, we highlighted specific distributive and procedural fairness issues inherent either to the computing process or to the system’s use in a real-world scenario: (1) the unjustified unequal distribution of predictive outcome; (2) the perpetuation of existing bias and discrimination practices; (3) the lack of transparency concerning the processed data and of an explanation of the algorithmic outcome for credit applicants. We addressed these issues proposing minimal ethical requirements for this specific application field: (1) regularly checking algorithmic outcome through the conditional demographic parity metric; (2) excluding from the group of processed parameters those that could lead to discriminatory outcome; (3) guaranteeing transparency about the processed data, in addition to counterfactual explainability of algorithmic decisions. Defining these minimal ethical requirements represents the main contribution of this paper and a starting point toward standards specifically addressing fairness issues in AI systems for creditworthiness assessments aiming at preventing unfair algorithmic outcomes, in addition to unfair practices related to the use of these systems. As a final result, we indicate the next steps that can be taken to begin the standardization of the three use case-specific fairness requirements we propose.

Shapley Lorenz Values for Artificial Intelligence Risk Management

Explainable AI in Fintech Risk Management

SAFE Artificial Intelligence in Finance

Standardizing fairness-evaluation procedures: interdisciplinary insights on machine learning algorithms in creditworthiness assessments for small personal loans

Explainable AI in Credit Risk Management

SHAP and LIME: An Evaluation of Discriminative Power in Credit Risk

On the Failings of Shapley Values for Explainability

Rational Shapley Values

Explainable AI: Using Shapley Value to Explain Complex Anomaly Detection ML-Based Systems

Model interpretability of financial fraud detection by group SHAP

Explaining Credit Risk Scoring through Feature Contribution Alignment with Expert Risk Analysts

Explainable machine learning for financial risk management: two practical use cases

Financial Risk Management and Explainable, Trustworthy, Responsible AI

Explainable AI for survival analysis: a median-SHAP approach

Collective eXplainable AI: Explaining Cooperative Strategies and Agent Contribution in Multiagent Reinforcement Learning with Shapley Values

Artificial intelligence for risk analysis-A risk characterization perspective on advances, opportunities, and limitations

Evaluating SAFE AI principles using Wasserstein distance: a comparative study of Machine Learning models

Explaining Predictive Uncertainty with Information Theoretic Shapley Values

Analyzing credit spread changes using explainable artificial intelligence

Error Analysis of Shapley Value-Based Model Explanations: An Informative Perspective

A Perspective on Explainable Artificial Intelligence Methods: SHAP and LIME