An Introduction to Artificial Intelligence and Solutions to the Problems of Algorithmic Discrimination

Nicholas Schmidt,Bryce Stephens

DOI: https://doi.org/10.48550/arXiv.1911.05755

2019-11-09

Abstract:There is substantial evidence that Artificial Intelligence (AI) and Machine Learning (ML) algorithms can generate bias against minorities, women, and other protected classes. Federal and state laws have been enacted to protect consumers from discrimination in credit, housing, and employment, where regulators and agencies are tasked with enforcing these laws. Additionally, there are laws in place to ensure that consumers understand why they are denied access to services and products, such as consumer loans. In this article, we provide an overview of the potential benefits and risks associated with the use of algorithms and data, and focus specifically on fairness. While our observations generalize to many contexts, we focus on the fairness concerns raised in consumer credit and the legal requirements of the Equal Credit and Opportunity Act. We propose a methodology for evaluating algorithmic fairness and minimizing algorithmic bias that aligns with the provisions of federal and state anti-discrimination statutes that outlaw overt, disparate treatment, and, specifically, disparate impact discrimination. We argue that while the use of AI and ML algorithms heighten potential discrimination risks, these risks can be evaluated and mitigated, but doing so requires a deep understanding of these algorithms and the contexts and domains in which they are being used.

Computers and Society,Machine Learning

What problem does this paper attempt to address?

The problem this paper attempts to address is the issue of algorithmic discrimination that may arise from the application of Artificial Intelligence (AI) and Machine Learning (ML) algorithms in real-world scenarios. Specifically, the paper focuses on how to ensure that these technologies treat all groups fairly and transparently when used in decision-making in areas such as employment, consumer finance, and housing, especially for minorities, women, and other protected groups. The paper mentions that existing AI and ML algorithms may exhibit biases against certain groups. For example, facial recognition programs are more likely to misidentify people with darker skin tones, some recruitment tests may give lower scores to women who graduated from women's colleges or participated in women's sports, people of color may receive fewer marketing offers (including housing) due to social media behavior or geographic location, and minority groups may be incorrectly flagged as more likely to reoffend compared to white individuals.

Furthermore, as the application of AI, ML, and alternative data in automated decision-making becomes more widespread, regulators, legislators, and industry insiders are exploring the potential risks and benefits of these technologies, particularly in the credit market. There is a hope to expand credit access for consumers who are currently outside the traditional credit system by using non-traditional credit data. However, this approach also raises numerous compliance and policy issues, such as whether using educational attainment data in credit models violates the anti-discrimination provisions of the Equal Credit Opportunity Act (ECOA), and whether this practice might exacerbate historical credit inequalities.

Overall, the paper aims to explore how to leverage AI and ML technologies while ensuring they do not exacerbate or create new social injustices. It presents a series of issues and challenges that need to be considered, with the goal of providing guidance for future research and practice.