Economic span selection of bridge based on deep reinforcement learning

Leye Zhang,Xiangxiang Tian,Chengli Zhang,Hongjun Zhang
2024-07-09
Abstract:Deep Q-network algorithm is used to select economic span of bridge. Selection of bridge span has a significant impact on the total cost of bridge, and a reasonable selection of span can reduce engineering cost. Economic span of bridge is theoretically analyzed, and the theoretical solution formula of economic span is deduced. Construction process of bridge simulation environment is described in detail, including observation space, action space and reward function of the environment. Agent is constructed, convolutional neural network is used to approximate Q function,{\epsilon} greedy policy is used for action selection, and experience replay is used for training. The test verifies that the agent can successfully learn optimal policy and realize economic span selection of bridge. This study provides a potential decision-making tool for bridge design.
Machine Learning,Artificial Intelligence
What problem does this paper attempt to address?
The main objective of this paper is to address the problem of selecting the economic span of a bridge using deep reinforcement learning methods. Specifically, the authors construct a bridge simulation environment and apply the Deep Q-Network (DQN) algorithm to explore how to choose the economic span of a bridge. The economic span refers to the span value that minimizes the total cost of the superstructure and substructure. The paper details the construction process of the simulation environment, including the design of the observation space, action space, and reward function. By training the agent, using a convolutional neural network to approximate the Q-function, and employing the ε-greedy strategy for action selection, the training is ultimately conducted through experience replay. Experimental results show that the agent can successfully learn the optimal strategy to achieve the selection of the economic span, providing a potential decision-making tool for bridge design. In summary, the problems the paper attempts to solve are: 1. Deriving the theoretical formula for the economic span. 2. Constructing a bridge simulation environment for training the deep reinforcement learning agent. 3. Using the DQN algorithm to find the economic span that minimizes the total cost of the bridge. 4. Validating the effectiveness of the proposed method, providing new perspectives and tools for bridge design.