Abstract:Road maintenance planning is an integral part of road asset management. One of the main challenges in Maintenance and Rehabilitation (M&R) practices is to determine maintenance type and timing. This research proposes a framework using Reinforcement Learning (RL) based on the Long Term Pavement Performance (LTPP) database to determine the type and timing of M&R practices. A predictive DNN model is first developed in the proposed algorithm, which serves as the Environment for the RL algorithm. For the Policy estimation of the RL model, both DQN and PPO models are developed. However, PPO has been selected in the end due to better convergence and higher sample efficiency. Indicators used in this study are International Roughness Index (IRI) and Rutting Depth (RD). Initially, we considered Cracking Metric (CM) as the third indicator, but it was then excluded due to the much fewer data compared to other indicators, which resulted in lower accuracy of the results. Furthermore, in cost-effectiveness calculation (reward), we considered both the economic and environmental impacts of M&R treatments. Costs and environmental impacts have been evaluated with paLATE 2.0 software. Our method is tested on a hypothetical case study of a six-lane highway with 23 kilometers length located in Texas, which has a warm and wet climate. The results propose a 20-year M&R plan in which road condition remains in an excellent condition range. Because the early state of the road is at a good level of service, there is no need for heavy maintenance practices in the first years. Later, after heavy M&R actions, there are several 1-2 years of no need for treatments. All of these show that the proposed plan has a logical result. Decision-makers and transportation agencies can use this scheme to conduct better maintenance practices that can prevent budget waste and, at the same time, minimize the environmental impacts.

A deep reinforcement learning framework for life-cycle maintenance planning of regional deteriorating bridges using inspection data

Optimal Policy for Structure Maintenance: A Deep Reinforcement Learning Framework

An Advanced Multi-Agent Reinforcement Learning Framework of Bridge Maintenance Policy Formulation

Deep Reinforcement Learning for Long‐term Pavement Maintenance Planning

REINFORCEMENT LEARNING-BASED BRIDGE INSPECTION MANAGEMENT

Sustainable Life-Cycle Maintenance Policymaking for Network-Level Deteriorating Bridges with a Convolutional Autoencoder–Structured Reinforcement Learning Agent

Maintenance strategy of highway bridges based on life cycle function

A Maintenance Planning Framework using Online and Offline Deep Reinforcement Learning

A Deep Reinforcement Learning Approach for Maintenance Planning of Multi-Component Systems with Complex Structure

A Data‐driven Approach for Regional Bridge Condition Assessment Using Inspection Reports

Deep reinforcement learning driven inspection and maintenance planning under incomplete information and constraints

Synergetic-informed deep reinforcement learning for sustainable management of transportation networks with large action spaces

A deep reinforcement learning model for predictive maintenance planning of road assets: Integrating LCA and LCCA

Artificial Intelligence Based Structural Assessment for Regional Short- and Medium-Span Concrete Beam Bridges with Inspection Information

Probabilistic-based Optimization of Maintenance Actions for Deteriorating RC Bridges

The Model for Predicting the Remaining Service Life of Reinforced Concrete Bridges In-Service and Applicability

A Multi-Agent Ranking Proximal Policy Optimization Framework for Bridge Network Life-Cycle Maintenance Decision-Making

Multi-agent deep reinforcement learning with centralized training and decentralized execution for transportation infrastructure management

Optimum Life-Cycle Maintenance Strategies of Deteriorating Highway Bridges Subject to Seismic Hazard by a Hybrid Markov Decision Process Model

Optimization Research on Maintenance Strategy Model for Coastal Highway Bridge Based on Durability and Reliability

Large-Scale Maintenance and Rehabilitation Optimization for Multi-Lane Highway Asphalt Pavement: A Reinforcement Learning Approach