Abstract:Consider an actor making selection decisions using a series of classifiers, which we term a sequential screening process. The early stages filter out some applicants, and in the final stage an expensive but accurate test is applied to the individuals that make it to the final stage. Since the final stage is expensive, if there are multiple groups with different fractions of positives at the penultimate stage (even if a slight gap), then the firm may naturally only choose to the apply the final (interview) stage solely to the highest precision group which would be clearly unfair to the other groups. Even if the firm is required to interview all of those who pass the final round, the tests themselves could have the property that qualified individuals from some groups pass more easily than qualified individuals from others. Thus, we consider requiring Equality of Opportunity (qualified individuals from each each group have the same chance of reaching the final stage and being interviewed). We then examine the goal of maximizing quantities of interest to the decision maker subject to this constraint, via modification of the probabilities of promotion through the screening process at each stage based on performance at the previous stage. We exhibit algorithms for satisfying Equal Opportunity over the selection process and maximizing precision (the fraction of interview that yield qualified candidates) as well as linear combinations of precision and recall (recall determines the number of applicants needed per hire) at the end of the final stage. We also present examples showing that the solution space is non-convex, which motivate our exact and (FPTAS) approximation algorithms for maximizing the linear combination of precision and recall. Finally, we discuss the `price of' adding additional restrictions, such as not allowing the decision maker to use group membership in its decision process.

Picking Winners in Rounds of Elimination

A New Framework of Designing Sequential Ranking-and-selection Procedures.

The Role of Information Revelation in Elimination Contests

Disclosure and Favoritism in Sequential Elimination Contests

Invidious Comparisons: Ranking and Selection as Compound Decisions

Forthcoming in The Economic Journal The Role of Information Revelation in Elimination Contests

On a Competitive Secretary Problem with Deferred Selections

Organizational Selection of Innovation

Ranking and Selection with Two-Stage Decision

Fair Allocation through Selective Information Acquisition

Multi Stage Screening: Enforcing Fairness and Maximizing Efficiency in a Pre-Existing Pipeline

Competition and Recall in Selection Problems

Alea Iacta Est: Auctions, Persuasion, Interim Rules, and Dice

Making the Cut: A Bandit-based Approach to Tiered Interviewing

Adaptive Fully Sequential Selection Procedures with Linear and Nonlinear Control Variates

Knockout-Tournament Procedures for Large-Scale Ranking and Selection in Parallel Computing Environments

Optimal Computing Budget Allocation for Data-driven Ranking and Selection

Buying winners

Best Action Selection In A Stochastic Environment

Data-driven Ranking and Selection under Input Uncertainty