Abstract:Big data and Artificial Intelligence (“AI”) are revolutionizing the ways in which firms, governments, and employers classify individuals. Surprisingly, however, one of the most important threats to antidiscrimination regimes posed by this revolution is largely unexplored or misunderstood in the extant literature. This is the risk that modern algorithms will result in “proxy discrimination.” Proxy discrimination is a particularly pernicious subset of disparate impact. Like all forms of disparate impact, it involves a facially-neutral practice that disproportionately harms members of a protected class. But a practice producing a disparate impact only amounts to proxy discrimination when the usefulness to the discriminator of the facially-neutral practice derives, at least in part, from the very fact that it produces a disparate impact. Historically, this occurred when a firm intentionally sought to discriminate against members of a protected class by relying on a proxy for class membership, such as zip code. However, proxy discrimination need not be intentional when membership in a protected class is predictive of a discriminator’s facially-neutral goal, making discrimination “rational.” In these cases, firms may unwittingly proxy discriminate, knowing only that a facially-neutral practice produces desirable outcomes. This Article argues that AI and big data are game changers when it comes to this risk of unintentional, but “rational,” proxy discrimination. AIs armed with big data are inherently structured to engage in proxy discrimination whenever they are deprived of information about membership in a legally-suspect class whose predictive power cannot be measured more directly by non-suspect data available to the AI. Simply denying AIs access to the most intuitive proxies for such predictive but suspect characteristics does little to thwart this process; instead it simply causes AIs to locate less intuitive proxies. For these reasons, as AIs become even smarter and big data becomes even bigger, proxy discrimination will represent an increasingly fundamental challenge to anti-discrimination regimes that seek to limit discrimination based on protected traits that often happen to be directly predictive characteristics. Numerous anti-discrimination regimes do just that, limiting discrimination based on potentially predictive factors like preexisting conditions, genetics, disability, sex, and even race. This Article offers a menu of potential strategies for combatting this risk of proxy discrimination by AI, including prohibiting the use of non-approved types of discrimination, mandating the collection and disclosure of data about impacted individuals’ membership in legally protected classes, and requiring firms to employ statistical models that isolate only the predictive power of non-suspect variables.

The constitutionality of facially neutral affirmative action in the United States

Privileges, Immunities, and Affirmative Action in Medical Education

Affirmative Action: Path to Equality or Reverse Discrimination?

Reflection on Affirmative Action Admission Policy of Public Higher Education Institutions in the United States

Affirmative Algorithms: The Legal Grounds for Fairness as Awareness

Assessing the Potential Impact of a Nationwide Class-Based Affirmative Action System

Ascriptive Characteristics and Perceptions of Impropriety in the Rule of Law: Race, Gender, and Public Assessments of Whether Judges Can Be Impartial

Diversity in Plastic Surgery and the 2023 US Supreme Court Decision

Through a Glass, Darkly: Systemic Racism, Affirmative Action, and Disproportionate Minority Contact

New Trends of Judicial Review on Affirmative Action Admission Policy in U.S.Public Higher Education Institutions—— Examination Based on the Fisher Case

Explicit vs. statistical targeting in affirmative action: Theory and evidence from Chicago's exam schools

Perceiving Discrimination: Race, Gender, and Sexual Orientation in the Legal Workplace

White Attitudes toward Equal Opportunity and Affirmative Action

Changing Course: Understanding the Legal Landscape of Race-Conscious Admission Practices and Implications to Diversity-Promoting Strategies in Higher Education

Affirmative Action and Precollege Human Capital

Constitutional Implementation of Affirmative Action Policies in India

Foreign practice of positive discrimination

Development phases of U.S. employment anti-discrimination law and reflections on its dilemmas from the perspective of China

Proxy Discrimination in the Age of Artificial Intelligence and Big Data

Effects of Racial Demographics, Ideology, and Economic Threat on Majority Group Discrimination Claims

Understanding Fairness of Gender Classification Algorithms Across Gender-Race Groups