Abstract:We present a multi-agent Deep Reinforcement Learning (DRL) framework for managing large transportation infrastructure systems over their life-cycle. Life-cycle management of such engineering systems is a computationally intensive task, requiring appropriate sequential inspection and maintenance decisions able to reduce long-term risks and costs, while dealing with different uncertainties and constraints that lie in high-dimensional spaces. To date, static age- or condition-based maintenance methods and risk-based or periodic inspection plans have mostly addressed this class of optimization problems. However, optimality, scalability, and uncertainty limitations are often manifested under such approaches. The optimization problem in this work is cast in the framework of constrained Partially Observable Markov Decision Processes (POMDPs), which provides a comprehensive mathematical basis for stochastic sequential decision settings with observation uncertainties, risk considerations, and limited resources. To address significantly large state and action spaces, a Deep Decentralized Multi-agent Actor-Critic (DDMAC) DRL method with Centralized Training and Decentralized Execution (CTDE), termed as DDMAC-CTDE is developed. The performance strengths of the DDMAC-CTDE method are demonstrated in a generally representative and realistic example application of an existing transportation network in Virginia, USA. The network includes several bridge and pavement components with nonstationary degradation, agency-imposed constraints, and traffic delay and risk considerations. Compared to traditional management policies for transportation networks, the proposed DDMAC-CTDE method vastly outperforms its counterparts. Overall, the proposed algorithmic framework provides near optimal solutions for transportation infrastructure management under real-world constraints and complexities.

Collaborative multi-agents in dynamic industrial internet of things using deep reinforcement learning

Learning to Cooperate: Application of Deep Reinforcement Learning for Online AGV Path Finding.

Deep Reinforcement Learning Multi-Agent System for Resource Allocation in Industrial Internet of Things

Multi-agent deep reinforcement learning with centralized training and decentralized execution for transportation infrastructure management

Multi-Objective Optimization Using Adaptive Distributed Reinforcement Learning

Multi-Agent Reinforcement Learning for Traffic Flow Management of Autonomous Vehicles

Scalable Decentralized Cooperative Platoon using Multi-Agent Deep Reinforcement Learning

Efficient Domain Coverage for Vehicles with Second-Order Dynamics via Multi-Agent Reinforcement Learning

Multi-agent reinforcement learning-based dynamic task assignment for vehicles in urban transportation physical internet

Deep hierarchical reinforcement learning for collaborative object transportation by heterogeneous agents

Efficient Collaborative Multi-Agent Deep Reinforcement Learning for Large-Scale Fleet Management

Multi-agent reinforcement learning for intelligent resource allocation in IIoT networks

A deep reinforcement learning approach for multi-agent mobile robot patrolling

Multi-agent reinforcement learning-based dynamic task assignment for vehicles in urban transportation system

Hierarchical Reinforcement Learning with Opponent Modeling for Distributed Multi-agent Cooperation

Decentralized Multi-Agent Reinforcement Learning with Global State Prediction

A dynamic clustering technique based on deep reinforcement learning for Internet of vehicles

Multi-Agent Deep Reinforcement Learning for Cooperative and Competitive Autonomous Vehicles using AutoDRIVE Ecosystem

Multi-agent DRL for Edge Computing: A Real-Time Proportional Compute Offloading

Dynamic Dispatching for Large-Scale Heterogeneous Fleet via Multi-agent Deep Reinforcement Learning