Abstract:Purpose Most manufacturing plants choose the easy way of completely separating human operators from robots to prevent accidents, but as a result, it dramatically affects the overall quality and speed that is expected from human–robot collaboration. It is not an easy task to ensure human safety when he/she has entered a robot’s workspace, and the unstructured nature of those working environments makes it even harder. The purpose of this paper is to propose a real-time robot collision avoidance method to alleviate this problem. Design/methodology/approach In this paper, a model is trained to learn the direct control commands from the raw depth images through self-supervised reinforcement learning algorithm. To reduce the effect of sample inefficiency and safety during initial training, a virtual reality platform is used to simulate a natural working environment and generate obstacle avoidance data for training. To ensure a smooth transfer to a real robot, the automatic domain randomization technique is used to generate randomly distributed environmental parameters through the obstacle avoidance simulation of virtual robots in the virtual environment, contributing to better performance in the natural environment. Findings The method has been tested in both simulations with a real UR3 robot for several practical applications. The results of this paper indicate that the proposed approach can effectively make the robot safety-aware and learn how to divert its trajectory to avoid accidents with humans within the workspace. Research limitations/implications The method has been tested in both simulations with a real UR3 robot in several practical applications. The results indicate that the proposed approach can effectively make the robot be aware of safety and learn how to change its trajectory to avoid accidents with persons within the workspace. Originality/value This paper provides a novel collision avoidance framework that allows robots to work alongside human operators in unstructured and complex environments. The method uses end-to-end policy training to directly extract the optimal path from the visual inputs for the scene.

An AR-assisted Deep Reinforcement Learning-based approach towards mutual-cognitive safe human-robot interaction

Deep reinforcement learning-based safe interaction for industrial human-robot collaboration using intrinsic reward function

An Attention-Based Deep Learning Approach for Inertial Motion Recognition and Estimation in Human-Robot Collaboration

AR-based interaction for safe human-robot collaborative manufacturing

Robot obstacle avoidance system using deep reinforcement learning

A visual reasoning-based approach for mutual-cognitive human-robot collaboration

IoT-Enabled Robot Skin System for Enhancement of Safe Human-Robot Interaction

A mixed perception-based human-robot collaborative maintenance approach driven by augmented reality and online deep reinforcement learning

Proactive Human-Robot Co-Assembly: Leveraging Human Intention Prediction and Robust Safe Control

An Active Strategy for Safe Human–Robot Interaction Based on Visual–Tactile Perception

Towards Safe Multi-Level Human-Robot Interaction in Industrial Tasks

A Complementary Framework for Human-Robot Collaboration with a Mixed AR-Haptic Interface

Augmented reality user interface design and experimental evaluation for human-robot collaborative assembly

Safety-aware human-centric collaborative assembly

Implementation of Engagement Detection for Human–Robot Interaction in Complex Environments

Supporting Human–Robot Interaction in Manufacturing with Augmented Reality and Effective Human–Computer Interaction: A Review and Framework

Closed-Loop Robotic Arm Manipulation Based on Mixed Reality

A Mixed-Perception Approach for Safe Human–Robot Collaboration in Industrial Automation

A safe reinforcement learning approach for autonomous navigation of mobile robots in dynamic environments

Enhancing Human-Robot Collaboration in Industry 4.0 with AI-driven HRI

A framework and method for Human-Robot cooperative safe control based on digital twin