Abstract:With the progressive technological advancement of autonomous vehicles, taxi service providers are expected to offer driverless taxi systems that alleviate traffic congestion and pollution. However, it is challenging to maintain the efficiency and reliability of a taxi service system due to the complexity of the traffic network and fluctuating traffic demand. In this paper, we present a robust variant of the twin delayed deep deterministic policy gradient algorithm (TD3), namely, adaptive TD3 integrated with robust optimization (ATD3-RO), to implement a fleet of autonomous vehicles for a taxi service under uncertain passenger demand. Our proposed method incorporates an adaptive module for integer-valued action generation, which also enhances the model's resilience to a larger action space. Considering the uncertain demand of passengers, we design a perturbation sampling-based method to generate adversarial examples for robust training. Additionally, we propose a robust optimization-based strategy to generate a lower bound and guide the convergence of the critic network during the model training process. In our case study, we validate the efficacy of ATD3-RO by constructing a reinforcement learning simulator of the driverless taxi transportation system using real taxi data. The simulation results demonstrate that ATD3-RO outperforms the general TD3 algorithm and other state-of-the-art reinforcement-learning-based approaches while improving learning efficiency. We assess the algorithm's robustness against sudden changes in requests, e.g., a surge in demand at some traffic nodes caused by an emergent event. The results suggest that ATD3-RO performs adaptive actions that are aligned with the variations in passenger demand. Finally, we prove that our model can provide a reliable dispatching strategy even at various ratios between driverless taxis and passenger demand.

Using reinforcement learning to minimize taxi idle times

Optimizing Taxi Carpool Policies via Reinforcement Learning and Spatio-Temporal Mining

Optimize Taxi Driving Strategies Based On Reinforcement Learning

Spatial-temporal Pricing for Ride-Sourcing Platform with Reinforcement Learning

A Clustering-Based Multi-Agent Reinforcement Learning Framework for Finer-Grained Taxi Dispatching

A robust deep reinforcement learning approach to driverless taxi dispatching under uncertain demand

AdaPool: A Diurnal-Adaptive Fleet Management Framework using Model-Free Deep Reinforcement Learning and Change Point Detection

Optimising Stochastic Routing for Taxi Fleets with Model Enhanced Reinforcement Learning

Context-Aware Taxi Dispatching at City-Scale Using Deep Reinforcement Learning

Supply-Demand-aware Deep Reinforcement Learning for Dynamic Fleet Management

H-TD2: Hybrid Temporal Difference Learning for Adaptive Urban Taxi Dispatch

META: A City-Wide Taxi Repositioning Framework Based on Multi-Agent Reinforcement Learning

Where to go: Agent Guidance with Deep Reinforcement Learning in A City-Scale Online Ride-Hailing Service

Reinforcement Learning from Optimization Proxy for Ride-Hailing Vehicle Relocation

Autonomous Algorithm for Training Autonomous Vehicles with Minimal Human Intervention

Taxi Dispatch with Real-Time Sensing Data in Metropolitan Areas: A Receding Horizon Control Approach

Reinforcement Learning Based Optimal Operation Strategy for Electric Taxis

Intelligent Cruise Guidance and Vehicle Resource Management With Deep Reinforcement Learning

A Modular and Transferable Reinforcement Learning Framework for the Fleet Rebalancing Problem

Dynamic Matching Optimization in Ridesharing System Based on Reinforcement Learning

A Distributed Model-Free Ride-Sharing Approach for Joint Matching, Pricing, and Dispatching using Deep Reinforcement Learning