Abstract:As an emerging mobility-on-demand service, bike-sharing system (BSS) has spread all over the world by providing a flexible, cost-efficient, and environment-friendly transportation mode for citizens. Demand-supply unbalance is one of the main challenges in BSS because of the inefficiency of the existing bike repositioning strategy, which reallocates bikes according to a pre-defined periodic schedule without considering the highly dynamic user demands. While reinforcement learning has been used in some repositioning problems for mitigating demand-supply unbalance, there are significant barriers when extending it to BSS due to the dimension curse of action space resulting from the dynamic number of workers and bikes in the city. In this paper, we study these barriers and address them by proposing a novel bike repositioning system, namely BikeBrain, which consists of a demand prediction model and a spatio-temporal bike repositioning algorithm. Specifically, to obtain accurate and real-time usage demand for efficient bike repositioning, we first present a prediction model ST-NetPre, which directly predicts user demand considering the highly dynamic spatio-temporal characteristics. Furthermore, we propose a spatio-temporal cooperative multi-agent reinforcement learning method (ST-CBR) for learning the worker-based bike repositioning strategy in which each worker in BSS is considered an agent. Especially, ST-CBR adopts the centralized learning and decentralized execution way to achieve effective cooperation among large-scale dynamic agents based on Mean Field Reinforcement Learning (MFRL), while avoiding the huge dimension of action space. For dynamic action space, ST-CBR utilizes a SoftMax selector to select the specific action. Meanwhile, for the benefits and costs of agents’ operation, an efficient reward function is designed to seek an optimal control policy considering both immediate and future rewards. Extensive experiments are conducted based on large-scale real-world datasets, and the results have shown significant improvements of our proposed method over several state-of-the-art baselines on the demand-supply gap and operation cost measures.

A Feature Correlation Reinforce Clustering and Evolutionary Algorithm for the Green Bike-Sharing Reposition Problem

A machine learning based shared bikes scheduling method

Multiobjective Bike Repositioning in Bike-Sharing Systems Via a Modified Artificial Bee Colony Algorithm

A Shared Ride Matching Approach to Low-Carbon and Electrified Ridesplitting

Enhancing Carbon Efficiency in Shared Micro-Mobility Systems: an Agent-Based Fleet Size and Layout Assessment Approach

Dynamic repositioning in bike-sharing systems with uncertain demand: An improved rolling horizon framework

Efficient Bike-sharing Repositioning with Cooperative Multi-Agent Deep Reinforcement LearningJust Accepted

Efficient Bike-sharing Repositioning with Cooperative Multi-Agent Deep Reinforcement Learning

Rebalancing Strategy for Bike-Sharing Systems Based on the Model of Level of Detail

A Demand-Centric Repositioning Strategy for Bike-Sharing Systems

Dynamic Spatio-Temporal Interactive Clustering Strategy for Free-Floating Bike-Sharing

Dynamic Bike Reposition

An adaptive tabu search algorithm embedded with iterated local search and route elimination for the bike repositioning and recycling problem

A Bi-Objective Pollution Routing Optimisation Problem With Decentralised Cooperation and Split Delivery

Bike Sharing Station Placement Leveraging Heterogeneous Urban Open Data

BikeNet: Accurate Bike Demand Prediction Using Graph Neural Networks for Station Rebalancing

Multi-objective optimal scheduling model for shared bikes based on spatiotemporal big data

Rebalance Modern Bike Sharing System: Spatio-Temporal Data Prediction and Path Planning for Multiple Carriers.

A Comprehensive Framework for Dynamic Bike Rebalancing in a Large Bike Sharing Network

An Improved GRASP for the Bike-Sharing Rebalancing Problem

A Reinforcement Learning Approach for Dynamic Rebalancing in Bike-Sharing System