Abstract:As an emerging mobility-on-demand service, bike-sharing system (BSS) has spread all over the world by providing a flexible, cost-efficient, and environment-friendly transportation mode for citizens. Demand-supply unbalance is one of the main challenges in BSS because of the inefficiency of the existing bike repositioning strategy, which reallocates bikes according to a pre-defined periodic schedule without considering the highly dynamic user demands. While reinforcement learning has been used in some repositioning problems for mitigating demand-supply unbalance, there are significant barriers when extending it to BSS due to the dimension curse of action space resulting from the dynamic number of workers and bikes in the city. In this paper, we study these barriers and address them by proposing a novel bike repositioning system, namely BikeBrain, which consists of a demand prediction model and a spatio-temporal bike repositioning algorithm. Specifically, to obtain accurate and real-time usage demand for efficient bike repositioning, we first present a prediction model ST-NetPre, which directly predicts user demand considering the highly dynamic spatio-temporal characteristics. Furthermore, we propose a spatio-temporal cooperative multi-agent reinforcement learning method (ST-CBR) for learning the worker-based bike repositioning strategy in which each worker in BSS is considered an agent. Especially, ST-CBR adopts the centralized learning and decentralized execution way to achieve effective cooperation among large-scale dynamic agents based on Mean Field Reinforcement Learning (MFRL), while avoiding the huge dimension of action space. For dynamic action space, ST-CBR utilizes a SoftMax selector to select the specific action. Meanwhile, for the benefits and costs of agents’ operation, an efficient reward function is designed to seek an optimal control policy considering both immediate and future rewards. Extensive experiments are conducted based on large-scale real-world datasets, and the results have shown significant improvements of our proposed method over several state-of-the-art baselines on the demand-supply gap and operation cost measures.

A Hybrid Variable Neighborhood Search Algorithm Based on Grouping Strategies for the Static Bike Sharing Re-Positioning Problem

A Matheuristic Approach Based on Variable Neighborhood Search for the Static Repositioning Problem in Station-Based Bike-Sharing Systems

Multiobjective Bike Repositioning in Bike-Sharing Systems Via a Modified Artificial Bee Colony Algorithm

An adaptive tabu search algorithm embedded with iterated local search and route elimination for the bike repositioning and recycling problem

Dynamic repositioning in bike-sharing systems with uncertain demand: An improved rolling horizon framework

A heuristic algorithm for a single vehicle static bike sharing rebalancing problem

An Improved GRASP for the Bike-Sharing Rebalancing Problem

A Matheuristic Multi-Start Algorithm for a Novel Static Repositioning Problem in Public Bike-Sharing Systems

A Hybrid Adaptive Large Neighborhood Search and Tabu Search Algorithm for the Electric Vehicle Relocation Problem.

Dynamic Intra-Cell Repositioning in Free-Floating Bike-Sharing Systems Using Approximate Dynamic Programming

Efficient Bike-sharing Repositioning with Cooperative Multi-Agent Deep Reinforcement Learning

A Demand-Centric Repositioning Strategy for Bike-Sharing Systems

Exploring Travel Patterns and Static Rebalancing Strategies for Dockless Bike-Sharing Systems from Multi-Source Data: a Framework and Case Study

Multi-objective optimal scheduling model for shared bikes based on spatiotemporal big data

An adaptive large neighborhood search with path relinking for a class of vehicle‐routing problems with simultaneous pickup and delivery

Variable Neighborhood Search Heuristic for Storage Location Assignment and Storage/retrieval Scheduling under Shared Storage in Multi-Shuttle Automated Storage/retrieval Systems

Efficient Bike-sharing Repositioning with Cooperative Multi-Agent Deep Reinforcement LearningJust Accepted

Dynamic Bike Reposition

The one-station bike repositioning problem

A Reinforcement Learning Approach for Dynamic Rebalancing in Bike-Sharing System

Research on the location of shared bicycle parking points based on improved NSGA-II algorithm