Abstract:As an emerging mobility-on-demand service, bike-sharing system (BSS) has spread all over the world by providing a flexible, cost-efficient, and environment-friendly transportation mode for citizens. Demand-supply unbalance is one of the main challenges in BSS because of the inefficiency of the existing bike repositioning strategy, which reallocates bikes according to a pre-defined periodic schedule without considering the highly dynamic user demands. While reinforcement learning has been used in some repositioning problems for mitigating demand-supply unbalance, there are significant barriers when extending it to BSS due to the dimension curse of action space resulting from the dynamic number of workers and bikes in the city. In this paper, we study these barriers and address them by proposing a novel bike repositioning system, namely BikeBrain, which consists of a demand prediction model and a spatio-temporal bike repositioning algorithm. Specifically, to obtain accurate and real-time usage demand for efficient bike repositioning, we first present a prediction model ST-NetPre, which directly predicts user demand considering the highly dynamic spatio-temporal characteristics. Furthermore, we propose a spatio-temporal cooperative multi-agent reinforcement learning method (ST-CBR) for learning the worker-based bike repositioning strategy in which each worker in BSS is considered an agent. Especially, ST-CBR adopts the centralized learning and decentralized execution way to achieve effective cooperation among large-scale dynamic agents based on Mean Field Reinforcement Learning (MFRL), while avoiding the huge dimension of action space. For dynamic action space, ST-CBR utilizes a SoftMax selector to select the specific action. Meanwhile, for the benefits and costs of agents’ operation, an efficient reward function is designed to seek an optimal control policy considering both immediate and future rewards. Extensive experiments are conducted based on large-scale real-world datasets, and the results have shown significant improvements of our proposed method over several state-of-the-art baselines on the demand-supply gap and operation cost measures.

Rebalancing Bike-Sharing System With Deep Sequential Learning

BRAVO: Improving the Rebalancing Operation in Bike Sharing with Rebalancing Range Prediction.

A machine learning based shared bikes scheduling method

E-Sharing: Data-driven Online Optimization of Parking Location Placement for Dockless Electric Bike Sharing

Designing Van-Based Mobile Battery Swapping and Rebalancing Services for Dockless Ebike-Sharing Systems Based on the Dueling Double Deep Q-network

A Reinforcement Learning Approach for Dynamic Rebalancing in Bike-Sharing System

Mobility Modeling and Data-Driven Closed-Loop Prediction in Bike-Sharing Systems

Dual Policy Reinforcement Learning for Real-time Rebalancing in Bike-sharing Systems

Rebalancing Dockless Bike Sharing Systems

Efficient Bike-sharing Repositioning with Cooperative Multi-Agent Deep Reinforcement LearningJust Accepted

Efficient Bike-sharing Repositioning with Cooperative Multi-Agent Deep Reinforcement Learning

A Comprehensive Framework for Dynamic Bike Rebalancing in a Large Bike Sharing Network

A Deep Reinforcement Learning Framework for Rebalancing Dockless Bike Sharing Systems.

Network Rebalance and Operational Efficiency of Sharing Transportation System: Multi-Objective Optimization and Model Predictive Control Approaches

Multiobjective Bike Repositioning in Bike-Sharing Systems Via a Modified Artificial Bee Colony Algorithm

Dynamic repositioning in bike-sharing systems with uncertain demand: An improved rolling horizon framework

Dynamic Balancing-Charging Management for Shared Autonomous Electric Vehicle Systems: A Two-Stage Learning-Based Approach

eShare+: A Data-Driven Balancing Mechanism for Bike Sharing Systems Considering both Quality of Service and Maintenance

Rebalancing Strategy for Bike-Sharing Systems Based on the Model of Level of Detail

BikeNet: Accurate Bike Demand Prediction Using Graph Neural Networks for Station Rebalancing

Nonlinear Influence and Interaction Effect on the Imbalance of Metro-Oriented Dockless Bike-Sharing System