Abstract:An efficient urban bus control system has the potential to significantly reduce travel delays and streamline the allocation of transportation resources, thereby offering enhanced and user-friendly transit services to passengers. However, bus operation efficiency can be impacted by bus bunching. This problem is notably exacerbated when the bus system operates along a signalized corridor with unpredictable travel demand. To mitigate this challenge, we introduce a multi-strategy fusion approach for the longitudinal control of connected and automated buses. The approach is driven by a physics-informed deep reinforcement learning (DRL) algorithm and takes into account a variety of traffic conditions along urban signalized corridors. Taking advantage of connected and autonomous vehicle (CAV) technology, the proposed approach can leverage real-time information regarding bus operating conditions and road traffic environment. By integrating the aforementioned information into the DRL-based bus control framework, our designed physics-informed DRL state fusion approach and reward function efficiently embed prior physics and leverage the merits of equilibrium and consensus concepts from control theory. This integration enables the framework to learn and adapt multiple control strategies to effectively manage complex traffic conditions and fluctuating passenger demands. Three control variables, i.e., dwell time at stops, speed between stations, and signal priority, are formulated to minimize travel duration and ensure bus stability with the aim of avoiding bus bunching. We present simulation results to validate the effectiveness of the proposed approach, underlining its superior performance when subjected to sensitivity analysis, specifically considering factors such as traffic volume, desired speed, and traffic signal conditions.

Robust dynamic real-time control strategies for high-frequency bus service: a multi-agent reinforcement learning framework

Learning to Cooperate: Application of Deep Reinforcement Learning for Online AGV Path Finding.

Reducing Bus Bunching with Asynchronous Multi-Agent Reinforcement Learning

A Robust Integrated Multi-Strategy Bus Control System via Deep Reinforcement Learning

Mitigating Bus Bunching via Hierarchical Multi-Agent Reinforcement Learning

Multi-objective multi-agent deep reinforcement learning to reduce bus bunching for multiline services with a shared corridor

Robust Dynamic Bus Control: a Distributional Multi-Agent Reinforcement Learning Approach

Multi-agent deep reinforcement learning based real-time planning approach for responsive customized bus routes

A real-time synchronous dispatching and recharging strategy for multi-line electric bus systems

Dynamic Bus Holding Control Using Spatial-Temporal Data - A Deep Reinforcement Learning Approach

Multi-agent Fuzzy Signal Control with Bus Priority

Multi-Agent Reinforcement Learning for Cooperative Air Transportation Services in City-Wide Autonomous Urban Air Mobility

Integrating Conventional Headway Control with Reinforcement Learning to Avoid Bus Bunching

A Collaborative Optimization Method for Train Scheduling and Passenger Flow Assignment Based on Multi-Agent Reinforcement Learning

Combining multi-agent deep deterministic policy gradient and rerouting technique to improve traffic network performance under mixed traffic conditions

Joint Optimization of Traffic Signal Control and Vehicle Routing in Signalized Road Networks using Multi-Agent Deep Reinforcement Learning

Vehicle Dispatching and Routing of On-Demand Intercity Ride-Pooling Services: A Multi-Agent Hierarchical Reinforcement Learning Approach

Minimizing passenger waiting time in the multi-route bus fleet allocation problem through distributionally robust optimization and reinforcement learning

Multi-Vehicle Routing Problems with Soft Time Windows: A Multi-Agent Reinforcement Learning Approach

Enhancing urban metro system resilience under disruptive events through multi-agent reinforcement learning