Abstract:Problem definition : We use a realistically large, publicly available data set from a global fintech lender to simulate the impact of different antidiscrimination laws and their corresponding data management and model-building regimes on gender-based discrimination in the nonmortgage fintech lending setting. Academic/practical relevance : Our paper extends the conceptual understanding of model-based discrimination from computer science to a realistic context that simulates the situations faced by fintech lenders in practice, where advanced machine learning (ML) techniques are used with high-dimensional, feature-rich, highly multicollinear data. We provide technically and legally permissible approaches for firms to reduce discrimination across different antidiscrimination regimes whilst managing profitability. Methodology : We train statistical and ML models on a large and realistically rich publicly available data set to simulate different antidiscrimination regimes and measure their impact on model quality and firm profitability. We use ML explainability techniques to understand the drivers of ML discrimination. Results : We find that regimes that prohibit the use of gender (like those in the United States) substantially increase discrimination and slightly decrease firm profitability. We observe that ML models are less discriminatory, of better predictive quality, and more profitable compared with traditional statistical models like logistic regression. Unlike omitted variable bias—which drives discrimination in statistical models—ML discrimination is driven by changes in the model training procedure, including feature engineering and feature selection, when gender is excluded. We observe that down sampling the training data to rebalance gender, gender-aware hyperparameter selection, and up sampling the training data to rebalance gender all reduce discrimination, with varying trade-offs in predictive quality and firm profitability. Probabilistic gender proxy modeling (imputing applicant gender) further reduces discrimination with negligible impact on predictive quality and a slight increase in firm profitability. Managerial implications : A rethink is required of the antidiscrimination laws, specifically with respect to the collection and use of protected attributes for ML models. Firms should be able to collect protected attributes to, at minimum, measure discrimination and ideally, take steps to reduce it. Increased data access should come with greater accountability for firms.

Analyzing Bias in Sensitive Personal Information Used to Train Financial Models

Awareness in Practice: Tensions in Access to Sensitive Attribute Data for Antidiscrimination

The Double-Edged Sword of Big Data and Information Technology for the Disadvantaged: A Cautionary Tale from Open Banking

Ensuring Equitable Financial Decisions: Leveraging Counterfactual Fairness and Deep Learning for Bias

Hidden Technical Debts for Fair Machine Learning in Financial Services

Identifying, measuring, and mitigating individual unfairness for supervised learning models and application to credit risk models

The Sociodemographic Biases in Machine Learning Algorithms: A Biomedical Informatics Perspective

Antidiscrimination Laws, Artificial Intelligence, and Gender Bias: A Case Study in Nonmortgage Fintech Lending

Privacy at a Price: Exploring its Dual Impact on AI Fairness

Differential Privacy for Credit Risk Model

Understanding Unfairness in Fraud Detection through Model and Data Bias Interactions

In the Name of Fairness: Assessing the Bias in Clinical Record De-identification

Transitioning from Real to Synthetic data: Quantifying the bias in model

Simultaneous Improvement of ML Model Fairness and Performance by Identifying Bias in Data

Why Is My Classifier Discriminatory?

Insurance Discrimination and Fairness in Machine Learning: An Ethical Analysis

Analyzing Fairness of Classification Machine Learning Model with Structured Dataset

Understanding Bias in Machine Learning

Can Querying for Bias Leak Protected Attributes? Achieving Privacy With Smooth Sensitivity

Research on the Application of Deep Learning-based Differential Privacy Protection Models in Financial Big Data

Discussing ethical considerations and solutions for ensuring fairness in AI-driven financial services