Abstract:Achieving optimal order dispatching has been a long-standing challenge for online ride-hailing platforms. Early methods would make shortsighted matchings as they only consider order prices alone as the edge weights in the driver-order bipartite graph, thus harming the platform's revenue. To address this problem, recent works evaluate the value of the order's destination region to be the long-term income a driver could obtain in average in such region and incorporate it into the order's edge weight to influence the matching results. However, they often result in insufficient driver supplies in many regions, as the values evaluated in different regions vary greatly, mainly because the impact of one region's value on the future number of drivers and revenue in other regions is overlooked. This paper models such impact within a cooperative Markov game, which involves each value's impact over the platform's revenue with the goal to find the optimal region values for revenue maximization. To solve this game, our work proposes a novelgoal-reaching collaboration (GRC) algorithm that realizes credit assignment from a novel goal-reaching perspective, addressing the difficulty for accurate credit assignment with large-scale agents of previous methods and resolving the conflict between credit assignment and offline reinforcement learning. Specifically, during training, GRC predicts the city's future state through an environment model and utilizes a scoring model to rate the predicted states to judge their levels of profitability, where high-scoring states are regarded as the goal states. Then, the policies in the game are updated to promote the city to stay in the goal states for as long as possible. To evaluate GRC, we deploy a baseline policy online in several cities for three weeks to collect real-world dataset. Training and testing results on the collected dataset indicate that our GRC consistently outperforms the baselines in different cities and peak periods.

Effective credit assignment deep policy gradient multi-agent reinforcement learning for vehicle dispatch

Target-Value-Competition-Based Multi-Agent Deep Reinforcement Learning Algorithm for Distributed Nonconvex Economic Dispatch

Multi-Agent Reinforcement Learning for Order-dispatching via Order-Vehicle Distribution Matching

Deep Dispatching: A Deep Reinforcement Learning Approach for Vehicle Dispatching on Online Ride-Hailing Platform

A Deep Reinforcement Learning Approach to Ride-Sharing Vehicle Dispatching in Autonomous Mobility-on-Demand Systems.

Multi-task dispatch of shared autonomous electric vehicles for Mobility-on-Demand services - combination of deep reinforcement learning and combinatorial optimization method

Multi-agent Reinforcement Learning to Unify Order-Matching and Vehicle-Repositioning in Ride-Hailing Services

Dynamic Balancing-Charging Management for Shared Autonomous Electric Vehicle Systems: A Two-Stage Learning-Based Approach

A Multi-Agent Reinforcement Learning-Based Method for Multiple Electric Vehicles Charging Scheduling

Multi-Agent Deep Reinforcement Learning for Recharging-Considered Vehicle Scheduling Problem in Container Terminals

Multi-Agent Mix Hierarchical Deep Reinforcement Learning for Large-Scale Fleet Management

A Deep Value-network Based Approach for Multi-Driver Order Dispatching

Vehicle Dispatching and Routing of On-Demand Intercity Ride-Pooling Services: A Multi-Agent Hierarchical Reinforcement Learning Approach

Multi-agent reinforcement learning-based dynamic task assignment for vehicles in urban transportation physical internet

Multi-agent reinforcement learning-based dynamic task assignment for vehicles in urban transportation system

Multi-Stage Vehicle Dispatch for Community Group-buying Logistics via Deep Reinforcement Learning

Supply-Demand-aware Deep Reinforcement Learning for Dynamic Fleet Management

Credit assignment with predictive contribution measurement in multi-agent reinforcement learning

Multi-Agent Deep Reinforcement Learning enabled Computation Resource Allocation in a Vehicular Cloud Network

Rethinking Order Dispatching in Online Ride-Hailing Platforms

A Self-Attention-Based Deep Reinforcement Learning Approach for AGV Dispatching Systems