Evaluating Fairness in Black-box Algorithmic Markets: A Case Study of Ride Sharing in Chicago

Yuhan Liu,Yuhan Zheng,Siyuan Zhang,Lydia T. Liu
2024-07-30
Abstract:This study examines fairness within the rideshare industry, focusing on both drivers' wages and riders' trip fares. Through quantitative analysis, we found that drivers' hourly wages are significantly influenced by factors such as race/ethnicity, health insurance status, tenure to the platform, and working hours. Despite platforms' policies not intentionally embedding biases, disparities persist based on these characteristics. For ride fares, we propose a method to audit the pricing policy of a proprietary algorithm by replicating it; we conduct a hypothesis test to determine if the predicted rideshare fare is greater than the taxi fare, taking into account the approximation error in the replicated model. Challenges in accessing data and transparency hinder our ability to isolate discrimination from other factors, underscoring the need for collaboration with rideshare platforms and drivers to enhance fairness in algorithmic wage determination and pricing.
Human-Computer Interaction
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to evaluate the algorithm fairness in shared mobility platforms (such as Uber and Lyft), especially from two aspects: drivers' wages and passengers' fares. Specifically: 1. **Drivers' Wage Fairness**: - Through quantitative analysis, the author found that drivers' hourly wages are significantly affected by factors such as race/ethnicity, health insurance status, years of service on the platform, and working hours. Although the platform's policies do not intentionally embed biases, differences among these characteristics still exist. - The study used the Chicago Public Passenger Vehicle Chauffeur Survey dataset to evaluate the impact of different factors (such as age, race, education level, health insurance status, etc.) on drivers' incomes. 2. **Passengers' Fare Fairness**: - In order to audit the pricing strategies of proprietary algorithms, the author proposed a method to replicate the pricing algorithm and used hypothesis testing to determine whether the predicted shared - mobility fares are higher than taxi fares, while considering the approximation error in the replication model. - The study used the Transportation Network Providers Trips and Taxi Trips datasets to compare the pricing strategies of shared - mobility platforms and taxi companies in Chicago to evaluate whether there are unfair charging phenomena. ### Main Problem Summary - **Drivers' Wage Fairness**: The study aims to evaluate whether there are unfair phenomena in the algorithms of shared - mobility platforms when determining drivers' wages based on factors such as race, health insurance status, and years of service. - **Passengers' Fare Fairness**: The study attempts to evaluate whether the dynamic pricing strategies of shared - mobility platforms are fair and reasonable by replicating the pricing algorithm and conducting hypothesis testing, especially whether there are over - charging situations compared with traditional taxi pricing. ### Key Challenges - **Data Access and Transparency**: Due to the closed nature of algorithms and data, it is difficult for researchers to completely isolate the influence of discrimination factors from other variables. Therefore, it is necessary to cooperate with platforms and drivers to improve the transparency and fairness of algorithmic decisions. Through the research of these problems, the author hopes to reveal the potential unfair phenomena in shared - mobility platforms and provide a basis for relevant policy interventions.