Abstract:This work aims to understand how effective the typical admissions criteria used in physics are at identifying students who will complete the PhD. Through a multivariate statistical analysis of a sample that includes roughly one in eight students who entered physics PhD programs from 2000-2010, we find that the traditional admissions metrics of undergraduate GPA and the Graduate Records Examination (GRE) Quantitative, Verbal, and Physics Subject Tests do not predict completion in US physics graduate programs with the efficacy often assumed by admissions committees. We find only undergraduate GPA to have a statistically significant association with physics PhD completion across all models studied. In no model did GRE Physics or GRE Verbal predict PhD completion. GRE Quantitative scores had statistically significant relationships with PhD completion in two of four models studied. However, in practice, probability of completing the PhD changed by less than 10 percentage points for students scoring in the 10 ^th vs 90 ^th percentile of US test takers that were physics majors. Noting the significant race, gender, and citizenship gaps in GRE scores, these findings indicate that the heavy reliance on these test scores within typical PhD admissions process is a deterrent to increasing access, diversity, and equity in physics. Misuse of GRE scores selects against already-underrepresented groups and US citizens with tools that fail to meaningfully predict PhD completion. This is a draft; see the journal for the published version. Additionally included in blue text are several responses to queries about this work.

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is to evaluate whether the admission criteria commonly used in physics doctoral programs can effectively predict whether students can complete their doctoral degrees. Specifically, through multivariate statistical analysis, the author studied the data of some students who entered physics doctoral programs from approximately 2000 to 2010, and explored the effectiveness of traditional admission indicators such as undergraduate GPA (UGPA), and the scores of the quantitative, verbal, and physics subject tests of the Graduate Record Examination (GRE) in predicting the completion rate of physics graduate programs in the United States. ### Main Findings: 1. **Predictive Ability of UGPA**: Among all the studied models, UGPA is the only numerical indicator that is significantly correlated with the completion of a physics doctoral degree. For every one - point increase in UGPA, the probability of completing a doctoral degree increases significantly. 2. **Predictive Ability of GRE Scores**: - **GRE - P (Physics Subject Test)**: In any model, the score of GRE - P has no significant correlation with the completion of a doctoral degree. - **GRE - Q (Quantitative Test)**: In two models (all students and US - only students), the score of GRE - Q has a significant relationship with the completion of a doctoral degree, but the actual impact is relatively small. - **GRE - V (Verbal Test)**: In all models, the score of GRE - V has no significant correlation with the completion of a doctoral degree. 3. **Other Factors**: - **Gender**: In all models, gender has no significant correlation with the completion of a doctoral degree. - **Citizenship**: In all models, citizenship has no significant correlation with the completion of a doctoral degree. - **Program Ranking**: The probability of students in high - ranking programs (Tier 1) completing their doctoral degrees is significantly higher than that in low - ranking programs (Tier 3). ### Conclusion: The paper points out that traditional admission criteria such as GRE scores are not effective in predicting the completion of a physics doctoral degree, especially GRE - P and GRE - V. UGPA is the only indicator that shows significant predictive ability in all models. In addition, there are significant differences in the performance of GRE scores among different groups, which may lead to unfair treatment of minority and female students. Therefore, the paper suggests that the admission committees of physics doctoral programs re - evaluate the use of these traditional indicators to improve the fairness and diversity of the admission process.

Typical Physics PhD Admissions Criteria Limit Access to Underrepresented Groups but Fail to Predict Doctoral Completion, including some additional information

Analyzing admissions metrics as predictors of graduate GPA and whether graduate GPA mediates PhD completion

Using machine learning to understand physics graduate school admissions

An Analysis of Physics Graduate Admission Data

Investigating institutional influence on graduate program admissions by modelling physics GRE cut-off scores

Admission predictors for success in a mathematics graduate program

Investigating society's educational debts due to racism and sexism in student attitudes about physics using quantitative critical race theory

In a physics curriculum only introductory physics course grades show gender differences but do not predict future course performance for physics majors

Challenges faced by women and persons excluded because of their ethnicity and race in physics learning environments: Review of the literature and recommendations for departments and instructors

Survey of the physics landscape and attempts to improve diversity

The relationship between gender and academic performance in undergraduate physics students: The role of physics identity, perceived recognition, and self-efficacy

Ph.D. in physics as a hurdle race, and the "glass hurdles" for women

Investigation of students repeating calculus-based introductory physics courses by gender, ethnicity and race

Percent Grade Scale Amplifies Racial/Ethnic Inequities in Introductory Physics

Rubric-based holistic review: a promising route to equitable graduate admissions in physics

The academic career in physics as a "deal": Choosing physics within a gendered power structure and excellence as an extra hurdle for women

Associations between learning assistants, passing introductory physics, and equity: A quantitative critical race theory investigation

Bias in physics peer recognition does not explain gaps in perceived recognition

Progression in self-efficacy, interest, identity, sense of belonging, perceived recognition and effectiveness of peer interaction of physics majors and comparison with non-majors and Ph.D. students

Women in physics in the United States: Reaching toward equity and inclusion

A Leaky Pipe Dream? A Study of Gender Differences in Undergraduate Physics