Abstract:Bike-Sharing Systems provide eco-friendly urban mobility, contributing to the alleviation of traffic congestion and to healthier lifestyles. Efficiently operating such systems and maintaining high customer satisfaction is challenging due to the stochastic nature of trip demand, leading to full or empty stations. Devising effective rebalancing strategies using vehicles to redistribute bikes among stations is therefore of uttermost importance for operators. As a promising alternative to classical mathematical optimization, reinforcement learning is gaining ground to solve sequential decision-making problems. This paper introduces a spatio-temporal reinforcement learning algorithm for the dynamic rebalancing problem with multiple vehicles. We first formulate the problem as a Multi-agent Markov Decision Process in a continuous time framework. This allows for independent and cooperative vehicle rebalancing, eliminating the impractical restriction of time-discretized models where vehicle departures are synchronized. A comprehensive simulator under the first-arrive-first-serve rule is then developed to facilitate the learning process by computing immediate rewards under diverse demand scenarios. To estimate the value function and learn the rebalancing policy, various Deep Q-Network configurations are tested, minimizing the lost demand. Experiments are carried out on various datasets generated from historical data, affected by both temporal and weather factors. The proposed algorithms outperform benchmarks, including a multi-period Mixed-Integer Programming model, in terms of lost demand. Once trained, it yields immediate decisions, making it suitable for real-time applications. Our work offers practical insights for operators and enriches the integration of reinforcement learning into dynamic rebalancing problems, paving the way for more intelligent and robust urban mobility solutions.

Allocating Time and Location Information to Activity-Travel Patterns Through Reinforcement Learning.

Optimization and Simulation of Activity-Travel Sequence in ITS

Spatial-temporal Pricing for Ride-Sourcing Platform with Reinforcement Learning

Daily Schedule Recommendation in Urban Life Based on Deep Reinforcement Learning

A Deep Reinforcement Learning Based Real-Time Solution Policy for the Traveling Salesman Problem

A Reinforcement Learning Approach for Dynamic Rebalancing in Bike-Sharing System

Optimizing Transportation Dynamics at a City-Scale Using a Reinforcement Learning Framework

A Survey on Applications of Reinforcement Learning in Spatial Resource Allocation

A Dynamic Day-To-Day Departure Time and Route Choice Model for Bounded-Rational Individuals

Optimizing Taxi Carpool Policies via Reinforcement Learning and Spatio-Temporal Mining

A joint travel mode and departure time choice model in dynamic multimodal transportation networks based on deep reinforcement learning

Multi-agent reinforcement learning-based dynamic task assignment for vehicles in urban transportation system

A deep reinforcement learning with dynamic spatio-temporal graph model for solving urban logistics delivery planning problems

Long-term Joint Scheduling for Urban Traffic

Optimising Stochastic Routing for Taxi Fleets with Model Enhanced Reinforcement Learning

A novel activity pattern generation incorporating deep learning for transport demand models

Optimize Taxi Driving Strategies Based On Reinforcement Learning

Examining Active Travel Behavior Through Explainable Machine Learning: Insights from Beijing, China

Reinforcement Learning for Intermodal Transportation Planning with Time Windows and Limited Cargo Capacity

Dual Policy Reinforcement Learning for Real-time Rebalancing in Bike-sharing Systems

Reinforcement Learning Algorithm for Reusable Resource Allocation with Time-varying Reward