Abstract:Bike-Sharing Systems provide eco-friendly urban mobility, contributing to the alleviation of traffic congestion and to healthier lifestyles. Efficiently operating such systems and maintaining high customer satisfaction is challenging due to the stochastic nature of trip demand, leading to full or empty stations. Devising effective rebalancing strategies using vehicles to redistribute bikes among stations is therefore of uttermost importance for operators. As a promising alternative to classical mathematical optimization, reinforcement learning is gaining ground to solve sequential decision-making problems. This paper introduces a spatio-temporal reinforcement learning algorithm for the dynamic rebalancing problem with multiple vehicles. We first formulate the problem as a Multi-agent Markov Decision Process in a continuous time framework. This allows for independent and cooperative vehicle rebalancing, eliminating the impractical restriction of time-discretized models where vehicle departures are synchronized. A comprehensive simulator under the first-arrive-first-serve rule is then developed to facilitate the learning process by computing immediate rewards under diverse demand scenarios. To estimate the value function and learn the rebalancing policy, various Deep Q-Network configurations are tested, minimizing the lost demand. Experiments are carried out on various datasets generated from historical data, affected by both temporal and weather factors. The proposed algorithms outperform benchmarks, including a multi-period Mixed-Integer Programming model, in terms of lost demand. Once trained, it yields immediate decisions, making it suitable for real-time applications. Our work offers practical insights for operators and enriches the integration of reinforcement learning into dynamic rebalancing problems, paving the way for more intelligent and robust urban mobility solutions.

Dynamic Bus Holding Control Using Spatial-Temporal Data - A Deep Reinforcement Learning Approach

A Robust Integrated Multi-Strategy Bus Control System via Deep Reinforcement Learning

Deep Reinforcement Learning based dynamic optimization of bus timetable

A real-time synchronous dispatching and recharging strategy for multi-line electric bus systems

A Mobile Data-Driven Hierarchical Deep Reinforcement Learning Approach for Real-time Demand-Responsive Railway Rescheduling and Station Overcrowding Mitigation

Dynamic Balancing-Charging Management for Shared Autonomous Electric Vehicle Systems: A Two-Stage Learning-Based Approach

Supply-Demand-aware Deep Reinforcement Learning for Dynamic Fleet Management

Robust dynamic real-time control strategies for high-frequency bus service: a multi-agent reinforcement learning framework

Assessing the sustainability of time-dependent electric demand responsive transit service through deep reinforcement learning

A deep reinforcement learning with dynamic spatio-temporal graph model for solving urban logistics delivery planning problems

Large Language Model-Enhanced Reinforcement Learning for Generic Bus Holding Control Strategies

Transit Signal Priority Strategy with Heterogeneous Graph-Based Deep Reinforcement Learning for Autonomous Public Transit Vehicles

AdaPool: A Diurnal-Adaptive Fleet Management Framework using Model-Free Deep Reinforcement Learning and Change Point Detection

Robust Dynamic Bus Control: a Distributional Multi-Agent Reinforcement Learning Approach

Multi-agent deep reinforcement learning based real-time planning approach for responsive customized bus routes

Integrating Conventional Headway Control with Reinforcement Learning to Avoid Bus Bunching

Vehicle Dispatching and Routing of On-Demand Intercity Ride-Pooling Services: A Multi-Agent Hierarchical Reinforcement Learning Approach

Reducing Bus Bunching with Asynchronous Multi-Agent Reinforcement Learning

Mitigating Bus Bunching via Hierarchical Multi-Agent Reinforcement Learning

A Reinforcement Learning Approach for Dynamic Rebalancing in Bike-Sharing System