Abstract:Bike-Sharing Systems provide eco-friendly urban mobility, contributing to the alleviation of traffic congestion and to healthier lifestyles. Efficiently operating such systems and maintaining high customer satisfaction is challenging due to the stochastic nature of trip demand, leading to full or empty stations. Devising effective rebalancing strategies using vehicles to redistribute bikes among stations is therefore of uttermost importance for operators. As a promising alternative to classical mathematical optimization, reinforcement learning is gaining ground to solve sequential decision-making problems. This paper introduces a spatio-temporal reinforcement learning algorithm for the dynamic rebalancing problem with multiple vehicles. We first formulate the problem as a Multi-agent Markov Decision Process in a continuous time framework. This allows for independent and cooperative vehicle rebalancing, eliminating the impractical restriction of time-discretized models where vehicle departures are synchronized. A comprehensive simulator under the first-arrive-first-serve rule is then developed to facilitate the learning process by computing immediate rewards under diverse demand scenarios. To estimate the value function and learn the rebalancing policy, various Deep Q-Network configurations are tested, minimizing the lost demand. Experiments are carried out on various datasets generated from historical data, affected by both temporal and weather factors. The proposed algorithms outperform benchmarks, including a multi-period Mixed-Integer Programming model, in terms of lost demand. Once trained, it yields immediate decisions, making it suitable for real-time applications. Our work offers practical insights for operators and enriches the integration of reinforcement learning into dynamic rebalancing problems, paving the way for more intelligent and robust urban mobility solutions.

Vehicle Rebalancing Under Adherence Uncertainty

BRAVO: Improving the Rebalancing Operation in Bike Sharing with Rebalancing Range Prediction.

Simulating On-Demand Ride Services in a Manhattan-like Urban Network Considering Traffic Dynamics

Spatial-temporal Pricing for Ride-Sourcing Platform with Reinforcement Learning

Predictive Vehicle Repositioning for On-Demand Ride-Pooling Services

Fairness-Enhancing Vehicle Rebalancing in the Ride-hailing System

Rebalancing the Rebalancers: Optimally Routing Vehicles and Drivers in Mobility-on-Demand Systems

i-Rebalance: Personalized Vehicle Repositioning for Supply Demand Balance

A Reinforcement Learning Approach for Dynamic Rebalancing in Bike-Sharing System

Simulation Framework for Rebalancing of Autonomous Mobility on Demand Systems

Equilibrium Inverse Reinforcement Learning for Ride-hailing Vehicle Network

Real-time and Large-scale Fleet Allocation of Autonomous Taxis: A Case Study in New York Manhattan Island

A robust deep reinforcement learning approach to driverless taxi dispatching under uncertain demand

Dynamic balance between demand-and-supply of urban taxis over trajectories

A prediction-based iterative Kuhn-Munkres approach for service vehicle reallocation in ride-hailing

Taxi dispatching strategies with compensations

Taxi Dispatch with Real-Time Sensing Data in Metropolitan Areas: A Receding Horizon Control Approach

Optimality-guaranteed Algorithms on the Dynamic Shared-Taxi Problem

Dynamic ride-sourcing systems for city-scale networks, Part II: Proactive vehicle repositioning

Vehicle Redistribution in Ride-Sourcing Markets using Convex Minimum Cost Flows

A Balanced Assignment Mechanism for Online Taxi Recommendation.