Abstract:A fundamental question in any peer-to-peer ridesharing system is how to, both effectively and efficiently, dispatch user's ride requests to the right driver in real time. Traditional rule-based solutions usually work on a simplified problem setting, which requires a sophisticated hand-crafted weight design for either centralized authority control or decentralized multi-agent scheduling systems. Although recent approaches have used reinforcement learning to provide centralized combinatorial optimization algorithms with informative weight values, their single-agent setting can hardly model the complex interactions between drivers and orders. In this paper, we address the order dispatching problem using multi-agent reinforcement learning (MARL), which follows the distributed nature of the peer-to-peer ridesharing problem and possesses the ability to capture the stochastic demand-supply dynamics in large-scale ridesharing scenarios. Being more reliable than centralized approaches, our proposed MARL solutions could also support fully distributed execution through recent advances in the Internet of Vehicles (IoV) and the Vehicle-to-Network (V2N). Furthermore, we adopt the mean field approximation to simplify the local interactions by taking an average action among neighborhoods. The mean field approximation is capable of globally capturing dynamic demand-supply variations by propagating many local interactions between agents and the environment. Our extensive experiments have shown the significant improvements of MARL order dispatching algorithms over several strong baselines on the accumulated driver income (ADI), and order response rate measures. Besides, the simulated experiments with real data have also justified that our solution can alleviate the supply-demand gap during the rush hours, thus possessing the capability of reducing traffic congestion.

Multi-Agent Mix Hierarchical Deep Reinforcement Learning for Large-Scale Fleet Management

Efficient Collaborative Multi-Agent Deep Reinforcement Learning for Large-Scale Fleet Management

Multi-agent Reinforcement Learning to Unify Order-Matching and Vehicle-Repositioning in Ride-Hailing Services

Multi-Agent Reinforcement Learning for Order-dispatching via Order-Vehicle Distribution Matching

Vehicle Dispatching and Routing of On-Demand Intercity Ride-Pooling Services: A Multi-Agent Hierarchical Reinforcement Learning Approach

Collaborative Decision-making in Heterogeneous UAV Swarms Based on Multi-agent Deep Reinforcement Learning

Joint Optimization of Pricing, Dispatching and Repositioning in Ride-Hailing with Multiple Models Interplayed Reinforcement Learning

Scalable Deep Reinforcement Learning for Ride-Hailing

Multi-Agent Deep Reinforcement Learning for Recharging-Considered Vehicle Scheduling Problem in Container Terminals

Multi-Objective Distributional Reinforcement Learning for Large-Scale Order Dispatching.

HMDRL: Hierarchical Mixed Deep Reinforcement Learning to Balance Vehicle Supply and Demand

Multi-Agent Deep Reinforcement Learning for Large-Scale Platoon Coordination with Partial Information at Hubs

Supply-Demand-aware Deep Reinforcement Learning for Dynamic Fleet Management

Efficient Ridesharing Order Dispatching with Mean Field Multi-Agent Reinforcement Learning

Effective credit assignment deep policy gradient multi-agent reinforcement learning for vehicle dispatch

A Deep Reinforcement Learning Approach to Ride-Sharing Vehicle Dispatching in Autonomous Mobility-on-Demand Systems.

Coride: Joint Order Dispatching And Fleet Management For Multi-Scale Ride-Hailing Platforms

Fleet Rebalancing for Expanding Shared E-Mobility Systems: A Multi-Agent Deep Reinforcement Learning Approach

Dynamic Dispatching for Large-Scale Heterogeneous Fleet via Multi-agent Deep Reinforcement Learning

Multi-task dispatch of shared autonomous electric vehicles for Mobility-on-Demand services - combination of deep reinforcement learning and combinatorial optimization method

Optimizing Online Matching for Ride-Sourcing Services with Multi-Agent Deep Reinforcement Learning