Abstract:Purpose Most manufacturing plants choose the easy way of completely separating human operators from robots to prevent accidents, but as a result, it dramatically affects the overall quality and speed that is expected from human–robot collaboration. It is not an easy task to ensure human safety when he/she has entered a robot’s workspace, and the unstructured nature of those working environments makes it even harder. The purpose of this paper is to propose a real-time robot collision avoidance method to alleviate this problem. Design/methodology/approach In this paper, a model is trained to learn the direct control commands from the raw depth images through self-supervised reinforcement learning algorithm. To reduce the effect of sample inefficiency and safety during initial training, a virtual reality platform is used to simulate a natural working environment and generate obstacle avoidance data for training. To ensure a smooth transfer to a real robot, the automatic domain randomization technique is used to generate randomly distributed environmental parameters through the obstacle avoidance simulation of virtual robots in the virtual environment, contributing to better performance in the natural environment. Findings The method has been tested in both simulations with a real UR3 robot for several practical applications. The results of this paper indicate that the proposed approach can effectively make the robot safety-aware and learn how to divert its trajectory to avoid accidents with humans within the workspace. Research limitations/implications The method has been tested in both simulations with a real UR3 robot in several practical applications. The results indicate that the proposed approach can effectively make the robot be aware of safety and learn how to change its trajectory to avoid accidents with persons within the workspace. Originality/value This paper provides a novel collision avoidance framework that allows robots to work alongside human operators in unstructured and complex environments. The method uses end-to-end policy training to directly extract the optimal path from the visual inputs for the scene.

Dynamic Obstacle Avoidance Algorithm for Robot Arm Based on Deep Reinforcement Learning

Dynamical Obstacle Avoidance of Task- Constrained Mobile Manipulation Using Model Predictive Control

An obstacle avoidance method for robotic arm based on reinforcement learning

Moving Obstacle Avoidance for Redundant Manipulator Via Weighted Least Norm Method

A deep reinforcement learning based method for real-time path planning and dynamic obstacle avoidance

Improved Residual Reinforcement Learning for Dynamic Obstacle Avoidance of Robotic Arm

Reactive Execution of Learned Tasks with Real-Time Collision Avoidance in a Dynamic Environment

A Deep Reinforcement Learning Solution for the Low Level Motion Control of a Robot Manipulator System

Deep Reinforcement Learning Based Trajectory Planning Under Uncertain Constraints

Obstacle avoidance planning of autonomous vehicles using deep reinforcement learning

Reinforcement learning for path planning of free-floating space robotic manipulator with collision avoidance and observation noise

Real-time Obstacle Avoidance in Robotic Manipulation Using Imitation Learning

Reinforcement learning-based dynamic obstacle avoidance and integration of path planning

Robot obstacle avoidance system using deep reinforcement learning

Trajectory Planning of Robotic Manipulator in Dynamic Environment Exploiting DRL

Dynamic Obstacle Avoidance Technique for Mobile Robot Navigation Using Deep Reinforcement Learning

An Efficient Approach for Obstacle Avoidance and Navigation in Robots

An Adaptive Path Planning Approach for Digital Twin-Enabled Robot Arm Based on Inverse Kinematics and Deep Reinforcement Learning

Dual-Arm Obstacle Avoidance Motion Planning Based on Improved RRT Algorithm

Integrating DeepRL with Robust Low-Level Control in Robotic Manipulators for Non-Repetitive Reaching Tasks

Path Planning of 6-DOF Free-Floating Space Robotic Manipulators Using Reinforcement Learning