Human–Robot Collaboration in Construction: Classification and Research Trends

C. Liang,Xi Wang,V. Kamat,C. Menassa

DOI: https://doi.org/10.1061/(ASCE)CO.1943-7862.0002154

2021-10-01

Abstract:AbstractConstruction robots continue to be increasingly deployed on construction sites to assist human workers in various tasks to improve safety, efficiency, and productivity. Due to the recent an...

Computer Science

What problem does this paper attempt to address?

Intelligent Robots and Human–robot Collaboration in the Construction Industry: A Review

Hsi-Hien Wei,Yuting Zhang,Ximing Sun,Jiayu Chen,Shixian Li

DOI: https://doi.org/10.26599/jic.2023.9180002

2023-01-01

Abstract:The construction industry is a typical labor-intensive industry, which suffers from low productivity and labor shortage in the past decades. Recently, the developments in robotics and artificial intelligence technologies highlight the evolutionary reforming potential in the construction industry. An increasing number of robots are joining construction tasks and collaborating with human workers. This study reviews the major developments in intelligent robots and human–robot collaboration (HRC) in the construction industry. The technological foundations and fundamental concepts of construction robots and collaborative robots are reviewed, organized, and discussed to reveal that progress has been made. Based on a comprehensive review, the major challenges and future research directions of HRC have been proposed and examined. This study finally developed a comprehensive and in-depth discussion of the state-of-the-art implementation of robotics technologies in the construction industry and shed light on its path to future development.
A Human-Robot Collaboration System for Object Handover

Yifei Yang,Longzhong Lin,Yifan Zhang,Zhongxiang Zhou,Yue Wang,Rong Xiong

DOI: https://doi.org/10.1109/robio54168.2021.9739333

2021-01-01

Abstract:Humans and robots are the two main labor in industry, and they have respective advantages. Human-Robot Collaboration combines the advantages of humans and robots, which makes it a research hotspot. While there are a lot of research and developments in the field of Human-Robot Collaboration, how to apply and optimize existing technologies to realize a complete Human-Robot Collaboration system is not a very focused problem. So, we realize a Human-Robot Collaboration system for object handover: the human holds a container (denoted as ContainerA), and the robot holds the other container (denoted as ContainerB) with some contents as a collaborator; the robot uses computer vision to detect ContainerA and estimate position and orientation of it; then the robot plans and controls the motion of the robot arm based on the visual information, and hand over the contents in ContainerB to ContainerA. For computer vision, we use Fast- SCNN for semantic segmentation and REDE for pose estimation, which can obtain the accurate pose of the hand-held container in real time. In terms of robot arm motion planning and control, we perform speed control based on artificial potential field and admittance control to achieve a smooth follow-up movement.
Intelligent Technologies for Construction Machinery Using Data-Driven Methods

Zhe Zheng,Fei Wang,Guofang Gong,Huayong Yang,Dong Han

DOI: https://doi.org/10.1016/j.autcon.2022.104711

IF: 10.3

2023-01-01

Automation in Construction

Abstract:Along with the rapid development of infrastructure worldwide, traditional manual operations have been a concern that restricts the high efficiency, safety, and quality of construction sites. Benefiting the significant improvements of smart manufacturing and artificial intelligence (AI), intelligent construction machinery has been considered a novel solution to address human operations' shortcomings, which are mainly reflected in prognostic and health management (PHM), environment perception, and automation control. Relevant data-driven methods have achieved important advancement while lacking a comprehensive summary. Hence, this paper surveyed a wide range of research works reported in the literature which realized few-manned or unattended construction sites. At first, several widely-used AI algorithms and their variations were introduced. Secondly, three aspects were discussed in detail: PHM applications based on experiment environments, environment perception systems in terms of information mediums, and automation control methods according to training mechanisms. Finally, several research outlooks and challenges were put forward.
A Review of Human-Machine Cooperation in the Robotics Domain

Canjun Yang,Yuanchao Zhu,Yanhu Chen

DOI: https://doi.org/10.1109/thms.2021.3131684

2022-01-01

IEEE Transactions on Human-Machine Systems

Abstract:Artificial intelligence (AI) technology has greatly expanded human capabilities through perception, understanding, action, and learning. The future of AI depends on cooperation between humans and AI. In addition to a fully automated or manually controlled machine, a machine can work in tandem with a human with different levels of assistance and automation. Machines and humans cooperate in different ways. Three strategies for cooperation are described in this article, as well as the nesting relationships among different control methods and cooperation strategies. Based on human thinking and behavior, a hierarchical human-machine cooperation (HMC) framework is improved and extended to design safe, efficient, and attractive systems. We review the common methods of perception, decision-making, and execution in the HMC framework. Future applications and trends of HMC are also discussed.
Human-robot Collaboration for Modular Construction Manufacturing: Review of Academic Research

Yonglin Fu,Junjie Chen,Weisheng Lu

DOI: https://doi.org/10.1016/j.autcon.2023.105196

IF: 10.3

2024-01-01

Automation in Construction

Abstract:By shifting most of the site work to factories, manufacturing becomes a critical phase in modular construction. Human-robot collaboration (HRC) is a promising approach to enhancing modular construction manufacturing (MCM) productivity while maintaining necessary flexibility. However, little attention has been paid to understanding, in a holistic manner, the past, present, and future of HRC in MCM. To fill in this gap, this study presents a review of 78 relevant publications on HRC in MCM, focusing on tasks, human roles, and interaction levels. HRC solutions are found applicable to various MCM tasks whereas existing research primarily focuses on timber component production. It also reveals that humans can play diverse collaborative roles and interact with robots at varying levels. Potential opportunities, challenges, and future directions are further discussed. The review deepens the understanding of HRC in MCM and inspires future research.
An Agent-based Approach for Modeling Human-robot Collaboration in Bricklaying

Ming-Hui Wu,Jia-Rui Lin

DOI: https://doi.org/10.22260/isarc2020/0110

2020-01-01

Abstract:An Agent-based Approach for Modeling Human-robot Collaboration in Bricklaying Ming-Hui Wu and Jia-Rui Lin Pages 797-804 (2020 Proceedings of the 37th ISARC, Kitakyushu, Japan, ISBN 978-952-94-3634-7, ISSN 2413-5844) Abstract: Construction robots have drawn attention in research and practice for decades. Considering most of the construction robots are not fully automated and humans are always involved in the construction process, how humans and robots collaborate has a great impact on the total productivity. Unlike collaboration systems between human-human, human-device and robot-robot, human-robot collaboration process has its complexity and uniqueness. Thus, this paper starts with analysis of human-robot collaboration system in construction, then provides an agent-based approach to simulate the process in bricklaying with emphasis on its complexity. A real project in Beijing is utilized to validate the feasibility of the proposed method. Besides, managerial insights useful for the workers to better utilize construction robots can be drawn from the results, which shows the effectiveness of the proposed model. This research contributes to the body of knowledge an agent-based approach to modeling, simulating, and analyzing the human-robot collaboration process in construction sites. This research serves as a foundation for further in-depth investigation in this area. Keywords: Construction robots; human-robot collaboration; agent-based simulation; communication mode; human factor DOI: https://doi.org/10.22260/ISARC2020/0110 Download fulltext Download BibTex Download Endnote (RIS) TeX Import to Mendeley
How Human-Robot Collaboration Impacts Construction Productivity: an Agent-Based Multi-Fidelity Modeling Approach

Minghui Wu,Jia-Rui Lin,Xin-Hao Zhang

DOI: https://doi.org/10.1016/j.aei.2022.101589

IF: 8.8

2022-01-01

Advanced Engineering Informatics

Abstract:Though construction robots have drawn attention in research and practice for decades, human-robot collaboration (HRC) remains important to conduct complex construction tasks. Considering its complexity and uniqueness, it is still unclear how HRC process will impact construction productivity, which is difficult to handle with conventional methods such as field tests, mathematical modeling and physical simulation approaches. To this end, an agent-based (AB) multi-fidelity modeling approach is introduced to simulate and evaluate how HRC influences construction productivity. A high-fidelity model is first proposed for a scenario with one robot. Then, a low-fidelity model is established to extract key parameters that capture the inner relationship among scenarios. The multi-fidelity models work together to simulate complex scenarios. Based on the simulation model, the twofold influence of HRC on productivity, namely the supplement strategy on the worker side, and the design for proactive interaction on the robot side, are fully investigated. Experimental results show that: 1) the proposed approach is feasible and flexible for simulation of complex HRC processes, and can cover multiple collaboration and interaction modes; 2) the influence of the supplement strategy is simple when there is only one robot, where lower Check Interval (CI) and higher Supplement Limit (SL) will improve productivity. But the influence becomes much more complicated when there are more robots due to the internal competition among robots for the limited time of workers; 3) HRC has a scale effect on productivity per robot, which means the productivity improves if there are more robots and workers, even if the human-robot ratio remains the same; 4) introducing proactive interaction between robots and workers could improve productivity significantly, up to 22% in our experiments, which further depends on the supplement strategy and the human-robot ratio. Overall, this research contributes an integrated approach to simulate and evaluate HRC's impacts on productivity as well as valuable insights on how to optimize HRC for better performance and occupational health. The proposed approach is also useful for the evaluation and development of new robots.
Toward a Framework for Trust Building between Humans and Robots in the Construction Industry: A Systematic Review of Current Research and Future Directions

Woei-Chyi Chang,Sogand Hasanzadeh

DOI: https://doi.org/10.1061/jccee5.cpeng-5656

IF: 5.802

2024-05-01

Journal of Computing in Civil Engineering

Abstract:With the construction sector primed to incorporate such advanced technologies as artificial intelligence (AI), robots, and machines, these advanced tools will require a deep understanding of human–robot trust dynamics to support safety and productivity. Although other disciplines have broadly investigated human trust-building with robots, the discussion within the construction domain is still nascent, raising concerns because construction workers are increasingly expected to work alongside robots or cobots, and to communicate and interact with drones. Without a better understanding of how construction workers can appropriately develop and calibrate their trust in their robotic counterparts, the implementation of advanced technologies may raise safety and productivity issues within these already-hazardous jobsites. Consequently, this study conducted a systematic review of the human–robot trust literature to (1) understand human–robot trust-building in construction and other domains; and (2) establish a roadmap for investigating and fostering worker–robot trust in the construction industry. The proposed worker–robot trust-building roadmap includes three phases: static trust based on the factors related to workers, robots, and construction sites; dynamic trust understood via measuring, modeling, and interpreting real-time trust behaviors; and adaptive trust, wherein adaptive calibration strategies and adaptive training facilitate appropriate trust-building. This roadmap sheds light on a progressive procedure to uncover the appropriate trust-building between workers and robots in the construction industry.

computer science, interdisciplinary applications,engineering, civil
Exploiting the Power of Human-Robot Collaboration: Coupling and Scale Effects in Bricklaying

Jia-Rui Lin,Ming-Hui Wu

DOI: https://doi.org/10.48550/arXiv.2212.05181

2022-12-10

Abstract:As an important contributor to GDP growth, the construction industry is suffering from labor shortage due to population ageing, COVID-19 pandemic, and harsh environments. Considering the complexity and dynamics of construction environment, it is still challenging to develop fully automated robots. For a long time in the future, workers and robots will coexist and collaborate with each other to build or maintain a facility efficiently. As an emerging field, human-robot collaboration (HRC) still faces various open problems. To this end, this pioneer research introduces an agent-based modeling approach to investigate the coupling effect and scale effect of HRC in the bricklaying process. With multiple experiments based on simulation, the dynamic and complex nature of HRC is illustrated in two folds: 1) agents in HRC are interdependent due to human factors of workers, features of robots, and their collaboration behaviors; 2) different parameters of HRC are correlated and have significant impacts on construction productivity (CP). Accidentally and interestingly, it is discovered that HRC has a scale effect on CP, which means increasing the number of collaborated human-robot teams will lead to higher CP even if the human-robot ratio keeps unchanged. Overall, it is argued that more investigations in HRC are needed for efficient construction, occupational safety, etc.; and this research can be taken as a stepstone for developing and evaluating new robots, optimizing HRC processes, and even training future industrial workers in the construction industry.

Robotics,Multiagent Systems
Natural Language Instructions for Intuitive Human Interaction with Robotic Assistants in Field Construction Work

Somin Park,Xi Wang,Carol C. Menassa,Vineet R. Kamat,Joyce Y. Chai

DOI: https://doi.org/10.1016/j.autcon.2024.105345

2023-07-12

Abstract:The introduction of robots is widely considered to have significant potential of alleviating the issues of worker shortage and stagnant productivity that afflict the construction industry. However, it is challenging to use fully automated robots in complex and unstructured construction sites. Human-Robot Collaboration (HRC) has shown promise of combining human workers' flexibility and robot assistants' physical abilities to jointly address the uncertainties inherent in construction work. When introducing HRC in construction, it is critical to recognize the importance of teamwork and supervision in field construction and establish a natural and intuitive communication system for the human workers and robotic assistants. Natural language-based interaction can enable intuitive and familiar communication with robots for human workers who are non-experts in robot programming. However, limited research has been conducted on this topic in construction. This paper proposes a framework to allow human workers to interact with construction robots based on natural language instructions. The proposed method consists of three stages: Natural Language Understanding (NLU), Information Mapping (IM), and Robot Control (RC). Natural language instructions are input to a language model to predict a tag for each word in the NLU module. The IM module uses the result of the NLU module and building component information to generate the final instructional output essential for a robot to acknowledge and perform the construction task. A case study for drywall installation is conducted to evaluate the proposed approach. The obtained results highlight the potential of using natural language-based interaction to replicate the communication that occurs between human workers within the context of human-robot teams.

Robotics,Artificial Intelligence,Human-Computer Interaction
Robotic deployment on construction sites: considerations for safety and productivity impact

Rafael Gomes Braga,Muhammad Owais Tahir,Ivanka Iordanova,David St-Onge

2024-05-13

Abstract:Deploying mobile robots in construction sites to collaborate with workers or perform automated tasks such as surveillance and inspections carries the potential to greatly increase productivity, reduce human errors, and save costs. However ensuring human safety is a major concern, and the rough and dynamic construction environments pose multiple challenges for robot deployment. In this paper, we present the insights we obtained from our collaborations with construction companies in Canada and discuss our experiences deploying a semi-autonomous mobile robot in real construction scenarios.

Robotics
Towards Human-Centered Construction Robotics: A Reinforcement Learning-Driven Companion Robot for Contextually Assisting Carpentry Workers

Yuning Wu,Jiaying Wei,Jean Oh,Daniel Cardoso Llach

2024-09-14

Abstract:In the dynamic construction industry, traditional robotic integration has primarily focused on automating specific tasks, often overlooking the complexity and variability of human aspects in construction workflows. This paper introduces a human-centered approach with a "work companion rover" designed to assist construction workers within their existing practices, aiming to enhance safety and workflow fluency while respecting construction labor's skilled nature. We conduct an in-depth study on deploying a robotic system in carpentry formwork, showcasing a prototype that emphasizes mobility, safety, and comfortable worker-robot collaboration in dynamic environments through a contextual Reinforcement Learning (RL)-driven modular framework. Our research advances robotic applications in construction, advocating for collaborative models where adaptive robots support rather than replace humans, underscoring the potential for an interactive and collaborative human-robot workforce.

Robotics,Artificial Intelligence,Human-Computer Interaction,Machine Learning
Research on human --- robot collaboration in rescue robotics

Haibo Tong,Rubo Zhang,Guanqun Liu

DOI: https://doi.org/10.1007/978-3-642-30976-2_72

2012-01-01

Abstract:This paper presents a human-robot collaboration framework which describes a comprehensive structure of rescue robots which are expected to collaborate with human in urban search and rescue (USAR). We develop a victim's autonomous search and rescue robotic system based on biomimetic sensing technology and discuss the information flow model and control mode transition between human and robot. The intelligence control architecture used for human-robot collaboration is also proposed. Experiments indicate that this system makes the collaboration convenient and the rescue robotics utilizing the intelligence control architecture search and discover victims promptly and efficiently.
Safe Human–robot Collaboration for Industrial Settings: a Survey

Weidong Li,Yudie Hu,Yong Zhou,Duc Truong Pham

DOI: https://doi.org/10.1007/s10845-023-02159-4

IF: 8.3

2023-01-01

Journal of Intelligent Manufacturing

Abstract:Human–robot collaboration (HRC) plays a pivotal role in today’s industry by supporting increasingly customised product development. Via HRC, the strengths of humans and robots can be combined to facilitate collaborative jobs within common workplaces to achieve specific industrial goals. Given the significance of safety assurance in HRC, in this survey paper, an update on standards and implementation approaches presented in the latest literature is given to reflect the state-of-the-art of this prominent research topic. First, an overview of safety standards for industrial robots, collaborative robots, and HRC is provided. Then, a survey of various approaches to HRC safety is conducted from two main perspectives, i.e., pre-collision and post-collision, which are further detailed in the aspects of sensing, prediction, learning, planning/replanning, and compliance control. Major characteristics, pros, cons, and applicability of the approaches are analysed. Finally, challenging issues and prospects for the future development of HRC safety are highlighted to provide recommendations for relevant stakeholders to consider when designing HRC-enabled industrial systems.
Human-robot Collaborative Assembly and Welding: A Review and Analysis of the State of the Art

Yue Cao,Quan Zhou,Wei Yuan,Qiang Ye,Dan Popa,YuMing Zhang

DOI: https://doi.org/10.1016/j.jmapro.2024.09.044

IF: 5.684

2024-01-01

Journal of Manufacturing Processes

Abstract:This paper reviews and analyzes the recent progress in human-robot collaborative (HRC) technologies that enhance assembly and welding processes. It focuses on how the HRC approach helps improve assembly and welding productivity and quality, while enabling complex process operations that cannot be accomplished by humans or robots/machines alone. It also discusses the basic elements in HRC approaches, including (1) human sensors, (2) signal processing for extraction of human intent from sensors, (3) presentation of information to the human for their reaction, obtained from environmental sensors that monitor the environment, machines, and processes, and (4) interface control, which manages how information is presented to the human, what reactions are expected from the human, and what needs to be presented next. Finally, it summarizes the state-of-the-art in the major elements and application accomplishments, identifies challenges for greater benefits, and proposes directions to address these challenges.
Progress and prospects of the human–robot collaboration

Arash Ajoudani,Andrea Maria Zanchettin,Serena Ivaldi,Alin Albu-Schäffer,Kazuhiro Kosuge,Oussama Khatib

DOI: https://doi.org/10.1007/s10514-017-9677-2

IF: 3.255

2017-10-31

Autonomous Robots

Abstract:Recent technological advances in hardware design of the robotic platforms enabled the implementation of various control modalities for improved interactions with humans and unstructured environments. An important application area for the integration of robots with such advanced interaction capabilities is human–robot collaboration. This aspect represents high socio-economic impacts and maintains the sense of purpose of the involved people, as the robots do not completely replace the humans from the work process. The research community’s recent surge of interest in this area has been devoted to the implementation of various methodologies to achieve intuitive and seamless human–robot-environment interactions by incorporating the collaborative partners’ superior capabilities, e.g. human’s cognitive and robot’s physical power generation capacity. In fact, the main purpose of this paper is to review the state-of-the-art on intermediate human–robot interfaces (bi-directional), robot control modalities, system stability, benchmarking and relevant use cases, and to extend views on the required future developments in the realm of human–robot collaboration.

robotics,computer science, artificial intelligence
An overview of cobots for advanced manufacturing: Human-robot interactions and research trends

Mohamed Khedr,and Erfu Yang

DOI: https://doi.org/10.1051/matecconf/202440112005

2024-08-29

MATEC Web of Conferences

Abstract:Advanced manufacturing is currently undergoing a significant transition towards human-robot collaboration. This shift has attracted considerable attention from researchers seeking to harness the synergistic potential of human and robotic capabilities across a range of applications and tasks. This paper presents a comprehensive review of the classification of robots, considering key aspects like architecture, mobility, function, size, autonomy, and human contact. The study goes deeper into collaborative robots by emphasizing the levels of interaction between robots and humans. To provide a comprehensive overview, a meticulous analysis of scientific publications spanning a two-decade period is conducted, with a focus on data collected over the past decade. Furthermore, the analysis extrapolates main trends and developments to offer insights for the next decade, thereby facilitating a comparative assessment of publication rates about both collaborative and industrial robots during this timeframe.
Recent Advancements of Robotics in Construction

Bo Xiao,Chen,Xianfei Yin

DOI: https://doi.org/10.1016/j.autcon.2022.104591

IF: 10.3

2022-01-01

Automation in Construction

Abstract:In the past two decades, robotics in construction (RiC) has become an interdisciplinary research field that in-tegrates a large number of urgent technologies (e.g., additive manufacturing, deep learning, building information modelling (BIM)), resulting in the related literature being both fragmented and vast. This paper has explored the advances in RiC in the past two decades using a mixed quantitative-qualitative review method. Initially, 940 related articles (170 journal articles and 770 conference papers) were identified by keyword-searching in Scopus and then fed into a bibliometric analysis to build science maps. Following this, a qualitative discussion highlights recent achievements in RiC across three dimensions: tasks, algorithms, and collaborations. Moreover, four future research directions are proposed: 1) in-depth integration of BIM and robotics; 2) near-site robotic fabrication; 3) deep reinforcement learning for flexible environment adaption; and 4) high-level robot-to-robot collaboration. The contributions of this research are twofold: 1) identifying the latest research topics and trends concerning robotic technologies in construction; and 2) providing in-depth insights into the future direction of RiC. The findings from this research can serve both academia and industry in terms of promoting robotic algorithms, hardware, and applications in construction industry.
Exploring three pillars of construction robotics via dual-track quantitative analysis

Yuming Liu,Aidi Hizami Bin Alias,Nuzul Azam Haron,Nabilah Abu Bakar,Hao Wang

DOI: https://doi.org/10.1016/j.autcon.2024.105391

IF: 10.3

2024-03-25

Automation in Construction

Abstract:Construction robotics has emerged as a leading technology in the construction industry. This paper conducts an innovative dual-track quantitative comprehensive method to analyze the current literature and assess future trends. First, a bibliometric review of 955 journal articles published between 1974 and 2023 was performed, exploring keywords, journals, countries, and clusters. Furthermore, a neural topic model based on BERTopic addresses topic modeling repetition issues. The study identifies building information modeling (BIM), human–robot collaboration (HRC), and deep reinforcement learning (DRL) as "three pillars" in the field. Additionally, we systematically reviewed the relevant literature and nested symbiotic relationships. The outcome of this study is twofold: first, the findings provide quantitative and qualitative scientific guidance for future research on trends; second, the innovative dual-track quantitative analysis research methodology simultaneously stimulates critical thinking about the modeling of other similarly trending topics characterized to avoid high degree of homogeneity and corpus overlap.

construction & building technology,engineering, civil

Human–Robot Collaboration in Construction: Classification and Research Trends

Intelligent Robots and Human–robot Collaboration in the Construction Industry: A Review

A Human-Robot Collaboration System for Object Handover

Intelligent Technologies for Construction Machinery Using Data-Driven Methods

A Review of Human-Machine Cooperation in the Robotics Domain

Human-robot Collaboration for Modular Construction Manufacturing: Review of Academic Research

An Agent-based Approach for Modeling Human-robot Collaboration in Bricklaying

How Human-Robot Collaboration Impacts Construction Productivity: an Agent-Based Multi-Fidelity Modeling Approach

Toward a Framework for Trust Building between Humans and Robots in the Construction Industry: A Systematic Review of Current Research and Future Directions

Exploiting the Power of Human-Robot Collaboration: Coupling and Scale Effects in Bricklaying

Natural Language Instructions for Intuitive Human Interaction with Robotic Assistants in Field Construction Work

Robotic deployment on construction sites: considerations for safety and productivity impact

Towards Human-Centered Construction Robotics: A Reinforcement Learning-Driven Companion Robot for Contextually Assisting Carpentry Workers

Research on human --- robot collaboration in rescue robotics

Safe Human–robot Collaboration for Industrial Settings: a Survey

Human-robot Collaborative Assembly and Welding: A Review and Analysis of the State of the Art

Progress and prospects of the human–robot collaboration

An overview of cobots for advanced manufacturing: Human-robot interactions and research trends

Recent Advancements of Robotics in Construction

Exploring three pillars of construction robotics via dual-track quantitative analysis