Abstract:Problem definition : We use a realistically large, publicly available data set from a global fintech lender to simulate the impact of different antidiscrimination laws and their corresponding data management and model-building regimes on gender-based discrimination in the nonmortgage fintech lending setting. Academic/practical relevance : Our paper extends the conceptual understanding of model-based discrimination from computer science to a realistic context that simulates the situations faced by fintech lenders in practice, where advanced machine learning (ML) techniques are used with high-dimensional, feature-rich, highly multicollinear data. We provide technically and legally permissible approaches for firms to reduce discrimination across different antidiscrimination regimes whilst managing profitability. Methodology : We train statistical and ML models on a large and realistically rich publicly available data set to simulate different antidiscrimination regimes and measure their impact on model quality and firm profitability. We use ML explainability techniques to understand the drivers of ML discrimination. Results : We find that regimes that prohibit the use of gender (like those in the United States) substantially increase discrimination and slightly decrease firm profitability. We observe that ML models are less discriminatory, of better predictive quality, and more profitable compared with traditional statistical models like logistic regression. Unlike omitted variable bias—which drives discrimination in statistical models—ML discrimination is driven by changes in the model training procedure, including feature engineering and feature selection, when gender is excluded. We observe that down sampling the training data to rebalance gender, gender-aware hyperparameter selection, and up sampling the training data to rebalance gender all reduce discrimination, with varying trade-offs in predictive quality and firm profitability. Probabilistic gender proxy modeling (imputing applicant gender) further reduces discrimination with negligible impact on predictive quality and a slight increase in firm profitability. Managerial implications : A rethink is required of the antidiscrimination laws, specifically with respect to the collection and use of protected attributes for ML models. Firms should be able to collect protected attributes to, at minimum, measure discrimination and ideally, take steps to reduce it. Increased data access should come with greater accountability for firms.

Architectures of Virtual Decision-Making: The Emergence of Gender Discrimination on a Crowdfunding Website

Gender Differences in the Effect of Communication on College Students' Online Decisions

Why Do Men Get More Attention? Exploring Factors Behind Success in an Online Design Community

Algorithmic Bias? An Empirical Study of Apparent Gender-Based Discrimination in the Display of STEM Career Ads

Effect of project role, age and gender differences on the formation and revision of project decision judgements

Quantifying Indirect Gender Discrimination on Collaborative Platforms

Gender stereotypes in equity crowdfunding: the effect of gender bias on the interpretation of quality signals

Debiasing Desire: Addressing Bias & Discrimination on Intimate Platforms

Gender-role Incongruity and Audience-based Gender Bias: An Examination of Networking among Entrepreneurs

Gender Bias in Decision-Making with Large Language Models: A Study of Relationship Conflicts

Antidiscrimination Laws, Artificial Intelligence, and Gender Bias: A Case Study in Nonmortgage Fintech Lending

A meta-analysis of gender stereotypes and bias in experimental simulations of employment decision making.

Insidious Nonetheless: How Small Effects and Hierarchical Norms Create and Maintain Gender Disparities in Organizations

Perceptions of Discriminatory Decisions of Artificial Intelligence: Unpacking the Role of Individual Characteristics

Gender Differences in Responses to Competitive Organization? A Field Experiment on Differences Between STEM and Non-STEM Fields from an Internet-of-Things Platform

Uncovering the Source of Machine Bias

Designing Resource Allocation Tools to Promote Fair Allocation: Do Visualization and Information Framing Matter?

The Effects of Gender Signals and Performance in Online Product Reviews

The hidden gender effect in online collaboration: An experimental study of team performance under anonymity

Discrimination in the Venture Capital Industry: Evidence from Field Experiments

Propagation of societal gender inequality by internet search algorithms