Abstract:After an earthquake, it is particularly important to provide the necessary resources on site because a large number of infrastructures need to be repaired or newly constructed. Due to the complex construction environment after the disaster, there are potential safety hazards for human labors working in this environment. With the advancement of robotic technology and artificial intelligent (AI) algorithms, smart robotic technology is the potential solution to provide construction resources after an earthquake. In this paper, the robotic crane with advanced AI algorithms is proposed to provide resources for infrastructure reconstruction after an earthquake. The proximal policy optimization (PPO), a reinforcement learning (RL) algorithm, is implemented for 3D lift path planning when transporting the construction materials. The state and reward function are designed in detail for RL model training. Two models are trained through a loading task in different environments by using PPO algorithm, one considering the influence of obstacles and the other not considering obstacles. Then, the two trained models are compared and evaluated through an unloading task and a loading task in simulation environments. For each task, two different cases are considered. One is that there is no obstacle between the initial position where the construction material is lifted and the target position, and the other is that there are obstacles between the initial position and the target position. The results show that the model that considering the obstacles during training can generate proper actions for the robotic crane to execute so that the crane can automatically transport the construction materials to the desired location with swing suppression, short time consumption and collision avoidance.

Application of Reinforcement Learning to Excavation Path Generation for Autonomous Excavator

Towards Autonomous and Optimal Excavation of Shield Machine:A Deep Reinforcement Learning-Based Approach

3D Operation of Autonomous Excavator based on Reinforcement Learning through Independent Reward for Individual Joints

Modeling and Control of General Hydraulic Excavator for Human-in-the-loop Automation

Learning Excavation of Rigid Objects with Offline Reinforcement Learning

Towards autonomous and optimal excavation of shield machine: a deep reinforcement learning-based approach

Research on Trajectory Planning and Autodig of Hydraulic Excavator

Path Following for Autonomous Ground Vehicle Using DDPG Algorithm: A Reinforcement Learning Approach

A General Approach for the Automation of Hydraulic Excavator Arms Using Reinforcement Learning

Deep Reinforcement Learning-based Task Assignment and Path Planning for Multi-agent Construction Robots

Automatic Evaluation of Excavator Operators using Learned Reward Functions

Adaptive Disassembly Sequence Planning for VR Maintenance Training Via Deep Reinforcement Learning

End-to-end deep learning for reverse driving trajectory of autonomous bulldozer

Design of Database-Driven Model Predictive Control System for Digging of an Autonomous Excavator

Data-driven excavation trajectory planning for unmanned mining excavator

Progressive-Resolution Policy Distillation: Leveraging Coarse-Resolution Simulation for Time-Efficient Fine-Resolution Policy Learning

Off-road Autonomous Vehicles Traversability Analysis and Trajectory Planning Based on Deep Inverse Reinforcement Learning

A reinforcement learning based construction material supply strategy using robotic crane and computer vision for building reconstruction after an earthquake

Database-driven model predictive control system for online adaptation of an autonomous excavator to environmental conditions

Enhancing Offline Coverage Path Planning with Deep Reinforcement Learning