Abstract:Flexible bus is a class of demand-responsive transit that provides door-to-door service. It is gaining popularity now but also encounters many challenges, such as high dynamism, immediacy requirements, and financial sustainability. Scientific literature designs flexible bus services only for reservation demand, overlooking the potential market for immediate demand that can improve ride pooling and financial sustainability. The increasing availability of historical travel demand data provides opportunities for leveraging future demand prediction in optimizing fleet utilization. This study investigates prediction failure risk-aware dynamic scheduling flexible bus services with hybrid requests allowing for both reservation and immediate demand. Equity in request waiting time for immediate demand is emphasized as a key objective. We model this problem as a multi-objective Markov decision process to jointly optimize vehicle routing, timetable, holding control and passenger assignment. To solve this problem, we develop a novel heuristics-guided multi-agent reinforcement learning (MARL) framework entailing three salient features: 1) incorporating the demand forecasting and prediction error correction modules into the MARL framework; 2) combining the benefits of MARL, local search algorithm, and imitation learning (IL) to improve solution quality; 3) incorporating an improved strategy in action selection with time-related information about spatio-temporal relationships between vehicles and passengers to enhance training efficiency. These enhancements are general methodological contributions to the artificial intelligence and operations research communities. Numerical experiments show that our proposed method is comparable to prevailing benchmark methods both with respect to training stability and solution quality. The benefit of demand prediction is significant even when the prediction is imperfect. Our model and algorithm are applied to a real-world case study in Guangzhou, China. Managerial insights are also provided.

Multiairport Departure Scheduling Via Multiagent Reinforcement Learning

Departure Scheduling for Multi-airport System Using Multi-agent Reinforcement Learning

A Large-Scale Multi-Objective Flights Conflict Avoidance Approach Supporting 4D Trajectory Operation.

A Multi-Agent Reinforcement Learning Approach for Conflict Resolution in Dense Traffic Scenarios

A Multi-Agent Reinforcement Learning Approach for System-Level Flight Delay Absorption

Real-Time Multi-Vehicle Scheduling in Tasks With Dependency Relationships Using Multi-Agent Reinforcement Learning

An extended memetic algorithm for multiobjective routing and scheduling of airport ground movements with intermediate holding

A Deep Multi-Agent Reinforcement Learning Approach to Autonomous Separation Assurance

Adaptive Dynamic Programming with Reinforcement Learning on Optimization of Flight Departure Scheduling

A Deep Ensemble Multi-Agent Reinforcement Learning Approach for Air Traffic Control

Simulated Annealing Method-Based Flight Schedule Optimization in Multiairport Systems

A Collaborative Optimization Method for Train Scheduling and Passenger Flow Assignment Based on Multi-Agent Reinforcement Learning

Autonomous Air Traffic Controller: A Deep Multi-Agent Reinforcement Learning Approach

Dynamic Scheduling of Flexible Bus Services with Hybrid Requests and Fairness: Heuristics-guided Multi-Agent Reinforcement Learning with Imitation Learning

A Distributed Assignment Method for Dynamic Traffic Assignment Using Heterogeneous-Adviser Based Multi-Agent Reinforcement Learning

General multi-agent reinforcement learning integrating heuristic-based delay priority strategy for demand and capacity balancing

General multi-agent reinforcement learning integrating adaptive manoeuvre strategy for real-time multi-aircraft conflict resolution

Joint Communication Resource Allocation and Velocity Optimization in Advanced Air Mobility via Multi-Agent Reinforcement Learning

Many-objective Optimization Scheduling Method of Arrival Flights

Adaptive Individual Q-Learning-A Multiagent Reinforcement Learning Method for Coordination Optimization

Dynamic flexible scheduling with transportation constraints by multi-agent reinforcement learning