Abstract:With the progressive technological advancement of autonomous vehicles, taxi service providers are expected to offer driverless taxi systems that alleviate traffic congestion and pollution. However, it is challenging to maintain the efficiency and reliability of a taxi service system due to the complexity of the traffic network and fluctuating traffic demand. In this paper, we present a robust variant of the twin delayed deep deterministic policy gradient algorithm (TD3), namely, adaptive TD3 integrated with robust optimization (ATD3-RO), to implement a fleet of autonomous vehicles for a taxi service under uncertain passenger demand. Our proposed method incorporates an adaptive module for integer-valued action generation, which also enhances the model's resilience to a larger action space. Considering the uncertain demand of passengers, we design a perturbation sampling-based method to generate adversarial examples for robust training. Additionally, we propose a robust optimization-based strategy to generate a lower bound and guide the convergence of the critic network during the model training process. In our case study, we validate the efficacy of ATD3-RO by constructing a reinforcement learning simulator of the driverless taxi transportation system using real taxi data. The simulation results demonstrate that ATD3-RO outperforms the general TD3 algorithm and other state-of-the-art reinforcement-learning-based approaches while improving learning efficiency. We assess the algorithm's robustness against sudden changes in requests, e.g., a surge in demand at some traffic nodes caused by an emergent event. The results suggest that ATD3-RO performs adaptive actions that are aligned with the variations in passenger demand. Finally, we prove that our model can provide a reliable dispatching strategy even at various ratios between driverless taxis and passenger demand.

Dual-objective Optimization of Taxi Dispatching in Simulated Road Network Based on Reinforcement Learning

Spatial-temporal Pricing for Ride-Sourcing Platform with Reinforcement Learning

Efficient Dispatching for On-Demand Ride Services: Systematic Optimization Via Monte-Carlo Tree Search

Optimize Taxi Driving Strategies Based On Reinforcement Learning

A Clustering-Based Multi-Agent Reinforcement Learning Framework for Finer-Grained Taxi Dispatching

Optimising Stochastic Routing for Taxi Fleets with Model Enhanced Reinforcement Learning

A robust deep reinforcement learning approach to driverless taxi dispatching under uncertain demand

H-TD2: Hybrid Temporal Difference Learning for Adaptive Urban Taxi Dispatch

META: A City-Wide Taxi Repositioning Framework Based on Multi-Agent Reinforcement Learning

Supply-Demand-aware Deep Reinforcement Learning for Dynamic Fleet Management

Context-Aware Taxi Dispatching at City-Scale Using Deep Reinforcement Learning

Dynamic Balancing-Charging Management for Shared Autonomous Electric Vehicle Systems: A Two-Stage Learning-Based Approach

Optimizing Taxi Carpool Policies via Reinforcement Learning and Spatio-Temporal Mining

Optimizing Transportation Dynamics at a City-Scale Using a Reinforcement Learning Framework

Taxi Dispatch with Real-Time Sensing Data in Metropolitan Areas: A Receding Horizon Control Approach

Dynamic Order Dispatching With Multiobjective Reward Learning

Multi-Agent Reinforcement Learning for Order-dispatching via Order-Vehicle Distribution Matching

Vehicle Dispatching and Routing of On-Demand Intercity Ride-Pooling Services: A Multi-Agent Hierarchical Reinforcement Learning Approach

Intelligent Cruise Guidance and Vehicle Resource Management With Deep Reinforcement Learning

Taxi dispatching strategies with compensations

Dynamic Matching Optimization in Ridesharing System Based on Reinforcement Learning