Abstract:Flexible bus is a class of demand-responsive transit that provides door-to-door service. It is gaining popularity now but also encounters many challenges, such as high dynamism, immediacy requirements, and financial sustainability. Scientific literature designs flexible bus services only for reservation demand, overlooking the potential market for immediate demand that can improve ride pooling and financial sustainability. The increasing availability of historical travel demand data provides opportunities for leveraging future demand prediction in optimizing fleet utilization. This study investigates prediction failure risk-aware dynamic scheduling flexible bus services with hybrid requests allowing for both reservation and immediate demand. Equity in request waiting time for immediate demand is emphasized as a key objective. We model this problem as a multi-objective Markov decision process to jointly optimize vehicle routing, timetable, holding control and passenger assignment. To solve this problem, we develop a novel heuristics-guided multi-agent reinforcement learning (MARL) framework entailing three salient features: 1) incorporating the demand forecasting and prediction error correction modules into the MARL framework; 2) combining the benefits of MARL, local search algorithm, and imitation learning (IL) to improve solution quality; 3) incorporating an improved strategy in action selection with time-related information about spatio-temporal relationships between vehicles and passengers to enhance training efficiency. These enhancements are general methodological contributions to the artificial intelligence and operations research communities. Numerical experiments show that our proposed method is comparable to prevailing benchmark methods both with respect to training stability and solution quality. The benefit of demand prediction is significant even when the prediction is imperfect. Our model and algorithm are applied to a real-world case study in Guangzhou, China. Managerial insights are also provided.

An Agent-Based Hybrid Model For Scheduling Delivery Vehicles

A New Framework for Dynamic Scheduling of Delivery Vehicles

A Hybrid Algorithm to Solve Periodic Vehicle Dispatching Problem with Heterogeneous Vehicles in Logistics Transportation.

Agent-Based Modeling and Simulation for Systematic Operations of Shared Automated Electric Vehicles

Modeling and Managing an On-Demand Meal Delivery System with Mixed Autonomy.

Hybrid Operations of Human Driving Vehicles and Automated Vehicles with Data-Driven Agent-Based Simulation

Van-based Robot Hybrid Pickup and Delivery Routing Problem

A Multi-Agent-Based Agile Scheduling Model for a Virtual Manufacturing Environment

An ACS-GA Hybrid Optimization Method to Solve Vehicle Routing Problem

Heterogeneous fleet vehicle scheduling problems for dynamic pickup and delivery problem with time windows in shared logistics platform: formulation, instances and algorithms

Hybrid modeling of collaborative freight transportation planning using agent-based simulation, auction-based mechanisms, and optimization

A dynamic integrated scheduling method based on hierarchical planning for heterogeneous AGV fleets in warehouses

An Agent-Based Approach for Dynamic Scheduling in Hybrid Flow Shops

Research on Agent-Based Approaches to Freight Transport Scheduling

Vehicle Dispatching and Routing of On-Demand Intercity Ride-Pooling Services: A Multi-Agent Hierarchical Reinforcement Learning Approach

Multi-AGV Scheduling Based on Hierarchical Intrinsically Rewarded Multi-Agent Reinforcement Learning

A hybrid collaborative framework for integrated production scheduling and vehicle routing problem with batch manufacturing and soft time windows

Dynamic Scheduling of Flexible Bus Services with Hybrid Requests and Fairness: Heuristics-guided Multi-Agent Reinforcement Learning with Imitation Learning

A hybrid multi-level optimisation framework for integrated production scheduling and vehicle routing with flexible departure time

Vehicle Scheduling by Freight Forwarder in Collecting-Dispatching System.

Real-Time Multi-Vehicle Scheduling in Tasks With Dependency Relationships Using Multi-Agent Reinforcement Learning