Abstract:Each year, selective American colleges sort through tens of thousands of applications to identify a first-year class that displays both academic merit and diversity. In the 2023-2024 admissions cycle, these colleges faced unprecedented challenges. First, the number of applications has been steadily growing. Second, test-optional policies that have remained in place since the COVID-19 pandemic limit access to key information historically predictive of academic success. Most recently, longstanding debates over affirmative action culminated in the Supreme Court banning race-conscious admissions. Colleges have explored machine learning (ML) models to address the issues of scale and missing test scores, often via ranking algorithms intended to focus on 'top' applicants. However, the Court's ruling will force changes to these models, which were able to consider race as a factor in ranking. There is currently a poor understanding of how these mandated changes will shape applicant ranking algorithms, and, by extension, admitted classes. We seek to address this by quantifying the impact of different admission policies on the applications prioritized for review. We show that removing race data from a developed applicant ranking algorithm reduces the diversity of the top-ranked pool without meaningfully increasing the academic merit of that pool. We contextualize this impact by showing that excluding data on applicant race has a greater impact than excluding other potentially informative variables like intended majors. Finally, we measure the impact of policy change on individuals by comparing the arbitrariness in applicant rank attributable to policy change to the arbitrariness attributable to randomness. We find that any given policy has a high degree of arbitrariness and that removing race data from the ranking algorithm increases arbitrariness in outcomes for most applicants.

Comparing School Choice and College Admission Mechanisms By Their Immunity to Strategic Admissions

Reforms meet fairness concerns in school and college admissions

Chinese College Admissions and School Choice Reforms: A Theoretical Analysis

A Motivation Perspective on College Admission Reform in Shanghai: The Effect of Providing More Choices and Multiple Evaluation Criteria

Chinese College Admissions Reforms : Experimental and Empirical Evaluations

Playing the system: address manipulation and access to schools

An empirical evaluation of Chinese college admissions reforms through a natural experiment

Chinese College Admissions and School Choice Reforms: an Experimental Study

Robustness to manipulations in school choice

From Boston to Shanghai to Deferred Acceptance: Theory and Experiments on a Family of School Choice Mechanisms

Multi-District School Choice: Playing on Several Fields

Causal Effects in Matching Mechanisms with Strategically Reported Preferences

When Do Stable Matching Mechanisms Fail? The Role of Standardized Tests in College Admissions

An experimental investigation of preference misrepresentation in the residency match

Ex-Ante Fairness under Constrained School Choice: an Experimental Approach

Best vs. All: Equity and Accuracy of Standardized Test Score Reporting

Trade-offs in School Choice: Comparing Deferred Acceptance, the Naive and the Classic Boston Mechanism

Strategic Ranking

Loss aversion in strategy-proof school-choice mechanisms

School Choice with Consent: An Experiment

Algorithms for College Admissions Decision Support: Impacts of Policy Change and Inherent Variability