Practical Marketplace Optimization at Uber Using Causally-Informed Machine Learning

Bobby Chen,Siyu Chen,Jason Dowlatabadi,Yu Xuan Hong,Vinayak Iyer,Uday Mantripragada,Rishabh Narang,Apoorv Pandey,Zijun Qin,Abrar Sheikh,Hongtao Sun,Jiaqi Sun,Matthew Walker,Kaichen Wei,Chen Xu,Jingnan Yang,Allen T. Zhang,Guoqing Zhang

2024-07-27

Abstract:Budget allocation of marketplace levers, such as incentives for drivers and promotions for riders, has long been a technical and business challenge at Uber; understanding lever budget changes' impact and estimating cost efficiency to achieve predefined budgets is crucial, with the goal of optimal allocations that maximize business value; we introduce an end-to-end machine learning and optimization procedure to automate budget decision-making for cities, relying on feature store, model training and serving, optimizers, and backtesting; proposing state-of-the-art deep learning (DL) estimator based on S-Learner and a novel tensor B-Spline regression model, we solve high-dimensional optimization with ADMM and primal-dual interior point convex optimization, substantially improving Uber's resource allocation efficiency.

Machine Learning

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the optimization of budget allocation in the Uber market. Specifically, Uber needs to allocate budgets to various market levers (such as incentives for drivers to complete specific trips or promotions for passengers to increase the number of trips) in different cities and regions to achieve predefined budget targets and maximize certain business - valuable goals. Traditional budget allocation methods mainly rely on human judgment and historical experience. This method is not only labor - intensive but also difficult to effectively use historical data to evaluate passenger and driver behaviors under different conditions, and also lacks clear goal - setting and is difficult to quantify its effects.

To solve these problems, the paper proposes an end - to - end machine - learning and optimization procedure aimed at automating the budget - decision - making process in Uber - operating cities. This procedure includes multiple applications such as feature storage, model training and serving, optimizer, and back - testing for measuring prediction and causal accuracy. The main contributions of the paper include:

1. **Introducing a novel S - Learner architecture** that combines spatio - temporal observation data and finer - grained experimental data as learning targets.
2. **Developing a student - model technique using B - splines** that enforces efficiency, business intuition, and teacher - model - response - shape control while marginalizing non - control features.
3. **Creating a fully - distributed optimizer** using the alternating direction multiplier method (ADMM) and the primal - dual interior - point convex - optimization method to handle complex, nonlinear, non - convex problems.
4. **Proposing a new method to evaluate counterfactual outputs** without a clean experimental environment, applicable to situations where standard methods such as randomized controlled trials (RCTs) or switch experiments cannot be implemented.

Through these techniques and methods, the system proposed in the paper can find the optimal budget - allocation scheme for each region and incentive lever while satisfying business - operation constraints, thereby significantly improving the efficiency of Uber's resource allocation.