Abstract:We present a multi-agent Deep Reinforcement Learning (DRL) framework for managing large transportation infrastructure systems over their life-cycle. Life-cycle management of such engineering systems is a computationally intensive task, requiring appropriate sequential inspection and maintenance decisions able to reduce long-term risks and costs, while dealing with different uncertainties and constraints that lie in high-dimensional spaces. To date, static age- or condition-based maintenance methods and risk-based or periodic inspection plans have mostly addressed this class of optimization problems. However, optimality, scalability, and uncertainty limitations are often manifested under such approaches. The optimization problem in this work is cast in the framework of constrained Partially Observable Markov Decision Processes (POMDPs), which provides a comprehensive mathematical basis for stochastic sequential decision settings with observation uncertainties, risk considerations, and limited resources. To address significantly large state and action spaces, a Deep Decentralized Multi-agent Actor-Critic (DDMAC) DRL method with Centralized Training and Decentralized Execution (CTDE), termed as DDMAC-CTDE is developed. The performance strengths of the DDMAC-CTDE method are demonstrated in a generally representative and realistic example application of an existing transportation network in Virginia, USA. The network includes several bridge and pavement components with nonstationary degradation, agency-imposed constraints, and traffic delay and risk considerations. Compared to traditional management policies for transportation networks, the proposed DDMAC-CTDE method vastly outperforms its counterparts. Overall, the proposed algorithmic framework provides near optimal solutions for transportation infrastructure management under real-world constraints and complexities.

Multi-agent simulation-Adaptive dynamic programming based reinforcement learning for evaluating joint delivery systems in relation to the different locations of urban consolidation centres

Learning to Cooperate: Application of Deep Reinforcement Learning for Online AGV Path Finding.

Multi-Agent Reinforcement Learning for Real-Time Dynamic Production Scheduling in a Robot Assembly Cell

Multi-Agent Reinforcement Learning with Hierarchical Coordination for Emergency Responder Stationing

Multi-agent reinforcement learning-based dynamic task assignment for vehicles in urban transportation system

Multi-agent Reinforcement Learning for Dynamic Dispatching in Material Handling Systems

Multi-agent deep reinforcement learning with centralized training and decentralized execution for transportation infrastructure management

Can Sophisticated Dispatching Strategy Acquired by Reinforcement Learning? - A Case Study in Dynamic Courier Dispatching System

Learning Locally, Communicating Globally: Reinforcement Learning of Multi-robot Task Allocation for Cooperative Transport

Collaborative multi-agents in dynamic industrial internet of things using deep reinforcement learning

Real-Time Multi-Vehicle Scheduling in Tasks With Dependency Relationships Using Multi-Agent Reinforcement Learning

Multiagent Reinforcement Learning Enhanced Decision-making of Crew Agents During Floor Construction Process

A Multi-Agent Reinforcement Learning Approach for System-Level Flight Delay Absorption

Deployment Optimization for Shared e-Mobility Systems With Multi-Agent Deep Neural Search

Population Game-Assisted Multi-Agent Reinforcement Learning Method for Dynamic Multi-Vehicle Route Selection

Multi-Objective Optimization Using Adaptive Distributed Reinforcement Learning

Multi-Agent Reinforcement Learning for Extended Flexible Job Shop Scheduling

Dynamic flexible scheduling with transportation constraints by multi-agent reinforcement learning

Vehicle Dispatching and Routing of On-Demand Intercity Ride-Pooling Services: A Multi-Agent Hierarchical Reinforcement Learning Approach

A Cooperative Multi-Agent Reinforcement Learning Framework for Resource Balancing in Complex Logistics Network