Abstract:The cost-effective management of aged infrastructure is an issue of worldwide concern. Markov decision process (MDP) models have been used in developing structural maintenance policies. Recent advances in the artificial intelligence (AI) community have shown that deep reinforcement learning (DRL) has the potential to solve large MDP optimization tasks. This paper proposes a novel automated DRL framework to obtain an optimized structural maintenance policy. The DRL framework contains a decision maker (AI agent) and the structure that needs to be maintained (AI task environment). The agent outputs maintenance policies and chooses maintenance actions, and the task environment determines the state transition of the structure and returns rewards to the agent under given maintenance actions. The advantages of the DRL framework include: (1) a deep neural network (DNN) is employed to learn the state-action Q value (defined as the predicted discounted expectation of the return for consequences under a given state-action pair), either based on simulations or historical data, and the policy is then obtained from the Q value; (2) optimization of the learning process is sample-based so that it can learn directly from real historical data collected from multiple bridges (i.e., big data from a large number of bridges); and (3) a general framework is used for different structure maintenance tasks with minimal changes to the neural network architecture. Case studies for a simple bridge deck with seven components and a long-span cable-stayed bridge with 263 components are performed to demonstrate the proposed procedure. The results show that the DRL is efficient at finding the optimal policy for maintenance tasks for both simple and complex structures.

A Deep Reinforcement Learning Method for Structural Dominant Failure Modes Searching Based on Self-Play Strategy

Structural dominant failure modes searching method based on deep reinforcement learning

Self-play Reinforcement Learning with Comprehensive Critic in Computer Games

Deep reinforcement learning-based sampling method for structural reliability assessment

Optimal Policy for Structure Maintenance: A Deep Reinforcement Learning Framework

A Deep Reinforcement Learning Approach for Maintenance Planning of Multi-Component Systems with Complex Structure

Adaptive Disassembly Sequence Planning for VR Maintenance Training Via Deep Reinforcement Learning

A novel reinforcement learning-based method for structure optimization

Probabilistic Automata-Based Method for Enhancing Performance of Deep Reinforcement Learning Systems

An Adaptive Structural Dominant Failure Modes Searching Method Based on Graph Neural Network

A deep reinforcement learning framework for life-cycle maintenance planning of regional deteriorating bridges using inspection data

A Deep Reinforcement Learning Approach to Dynamic Loading Strategy of Repairable Multistate Systems

Effective Reinforcement Learning Based on Structural Information Principles

A Safety-Enhanced Reinforcement Learning-Based Decision-Making Method by the Dimensionality Reduction Monte Carlo Tree Search

A physics‐informed deep reinforcement learning framework for autonomous steel frame structure design

Achieving Safe Deep Reinforcement Learning Via Environment Comprehension Mechanism

An Efficient Dominant Failure Modes Search Strategy and an Extended Sequential Compounding Method of System Reliability Analysis and Optimization

Research on Action Strategies and Simulations of DRL and MCTS-based Intelligent Round Game

A Maintenance Planning Framework using Online and Offline Deep Reinforcement Learning

Survival-Oriented Reinforcement Learning Model: an Effcient and Robust Deep Reinforcement Learning Algorithm for Autonomous Driving Problem.

Design Synthesis of Structural Systems as a Markov Decision Process Solved With Deep Reinforcement Learning