Abstract:Bike-Sharing Systems provide eco-friendly urban mobility, contributing to the alleviation of traffic congestion and to healthier lifestyles. Efficiently operating such systems and maintaining high customer satisfaction is challenging due to the stochastic nature of trip demand, leading to full or empty stations. Devising effective rebalancing strategies using vehicles to redistribute bikes among stations is therefore of uttermost importance for operators. As a promising alternative to classical mathematical optimization, reinforcement learning is gaining ground to solve sequential decision-making problems. This paper introduces a spatio-temporal reinforcement learning algorithm for the dynamic rebalancing problem with multiple vehicles. We first formulate the problem as a Multi-agent Markov Decision Process in a continuous time framework. This allows for independent and cooperative vehicle rebalancing, eliminating the impractical restriction of time-discretized models where vehicle departures are synchronized. A comprehensive simulator under the first-arrive-first-serve rule is then developed to facilitate the learning process by computing immediate rewards under diverse demand scenarios. To estimate the value function and learn the rebalancing policy, various Deep Q-Network configurations are tested, minimizing the lost demand. Experiments are carried out on various datasets generated from historical data, affected by both temporal and weather factors. The proposed algorithms outperform benchmarks, including a multi-period Mixed-Integer Programming model, in terms of lost demand. Once trained, it yields immediate decisions, making it suitable for real-time applications. Our work offers practical insights for operators and enriches the integration of reinforcement learning into dynamic rebalancing problems, paving the way for more intelligent and robust urban mobility solutions.

A Matheuristic Multi-Start Algorithm for a Novel Static Repositioning Problem in Public Bike-Sharing Systems

A Matheuristic Approach Based on Variable Neighborhood Search for the Static Repositioning Problem in Station-Based Bike-Sharing Systems

Multiobjective Bike Repositioning in Bike-Sharing Systems Via a Modified Artificial Bee Colony Algorithm

BRAVO: Improving the Rebalancing Operation in Bike Sharing with Rebalancing Range Prediction.

A machine learning based shared bikes scheduling method

The one-station bike repositioning problem

Dynamic repositioning in bike-sharing systems with uncertain demand: An improved rolling horizon framework

A heuristic algorithm for a single vehicle static bike sharing rebalancing problem

Dynamic Intra-Cell Repositioning in Free-Floating Bike-Sharing Systems Using Approximate Dynamic Programming

A Demand-Centric Repositioning Strategy for Bike-Sharing Systems

Dynamic Bike Reposition

Data-driven analysis of optimal repositioning policy in bike sharing systems

A Hybrid and Adaptive Metaheuristic for the Rebalancing Problem in Public Bicycle Systems

Dockless Bike-Sharing Reallocation Based on Data Analysis: Solving Complex Problem with Simple Method.

A Reinforcement Learning Approach for Dynamic Rebalancing in Bike-Sharing System

Optimizing bike rebalancing strategies in free-floating bike-sharing systems: An enhanced distributionally robust approach

Using metaheuristics for the location of bicycle stations

Placement optimisation for station‐free bicycle‐sharing under 1D distribution assumption

Minimizing Multimodular Functions and Allocating Capacity in Bike-Sharing Systems

An adaptive tabu search algorithm embedded with iterated local search and route elimination for the bike repositioning and recycling problem

Mobility Modeling and Data-Driven Closed-Loop Prediction in Bike-Sharing Systems