Abstract:The development and deployment of robots on construction sites are integral to the industrialization of construction, known as Construction 4.0. Tele-operated and pre-programmed robots have enhanced construction efficiency and safety. However, their utilization on-site remains limited due to the need for expert remote control and the lack of adaptability in dynamic environments. Reinforcement learning (RL) has emerged as a promising solution, as RL-controlled robots possess inherent self-learning abilities to adapt to diverse situations. Nevertheless, manual design of RL reward functions for complex tasks poses challenges. To address this issue, inverse reinforcement learning (IRL) methods, such as Generative Adversarial Imitation Learning (GAIL), have been proposed to learn optimal actions through expert demonstration and self-exploration, without explicitly defined reward functions. In this study, we propose an innovative approach integrating GAIL and virtual reality (VR) integrated robot control approach to control robots for long-horizon collaborative construction tasks involving multiple sub-tasks. We employ VR expert demonstrations as input for GAIL training, enabling a team of robots, including an Unmanned Ground Vehicle (UGV) and two robot arms, to interact with the designed RL environment and perform tasks such as transporting, picking, and installing window panels. Handle long-horizon collaborative construction tasks (i.e., a long sequence of several sub-tasks performed by multiple robots). For evaluation, we compare the performance of our VR-GAIL model with a prevalent and robust RL baseline model, Proximal Policy Optimization (PPO). The results demonstrate that our reward-free VR-GAIL model achieves, on average, a 4.5% higher success rate than the PPO counterpart equipped with carefully designed reward functions across all three sub-tasks and their randomized variations. Furthermore, the performance gap between GAIL and PPO widens as the task difficulty increases. These findings indicate that our approach effectively enhances RL agent performance in tackling complex construction tasks while expediting development by eliminating reward function design requirements.

An Improved GAIL Based on Object Detection, GRU, and Attention

GAN-Based Interactive Reinforcement Learning from Demonstration and Human Evaluative Feedback

Imitation Learning from Imperfect Demonstrations for AUV Path Tracking and Obstacle Avoidance

Model-based Adversarial Imitation Learning from Demonstrations and Human Reward

Efficient Off-policy Adversarial Imitation Learning with Imperfect Demonstrations

Adversarial imitation learning with mixed demonstrations from multiple demonstrators

A Pragmatic Look at Deep Imitation Learning

Triple-GAIL: A Multi-Modal Imitation Learning Framework with Generative Adversarial Nets

UAV Visual Flight Control Method Based on Deep Reinforcement Learning

Generative adversarial interactive imitation learning for path following of autonomous underwater vehicle

ARAIL: Learning to rank from incomplete demonstrations

UAV Target Tracking Method Based on Deep Reinforcement Learning

Diffusion-Reward Adversarial Imitation Learning

Wasserstein Distance guided Adversarial Imitation Learning with Reward Shape Exploration

Generative Adversarial Imitation Learning from Human Behavior with Reward Shaping

Enhancing construction robot learning for collaborative and long-horizon tasks using generative adversarial imitation learning

Generative Adversarial Imitation Learning from Failed Experiences

An AUV Target-Tracking Method Combining Imitation Learning and Deep Reinforcement Learning

Bootstrapping Reinforcement Learning with Imitation for Vision-Based Agile Flight

CRIL: Continual Robot Imitation Learning via Generative and Prediction Model