Abstract:Purpose Most manufacturing plants choose the easy way of completely separating human operators from robots to prevent accidents, but as a result, it dramatically affects the overall quality and speed that is expected from human–robot collaboration. It is not an easy task to ensure human safety when he/she has entered a robot’s workspace, and the unstructured nature of those working environments makes it even harder. The purpose of this paper is to propose a real-time robot collision avoidance method to alleviate this problem. Design/methodology/approach In this paper, a model is trained to learn the direct control commands from the raw depth images through self-supervised reinforcement learning algorithm. To reduce the effect of sample inefficiency and safety during initial training, a virtual reality platform is used to simulate a natural working environment and generate obstacle avoidance data for training. To ensure a smooth transfer to a real robot, the automatic domain randomization technique is used to generate randomly distributed environmental parameters through the obstacle avoidance simulation of virtual robots in the virtual environment, contributing to better performance in the natural environment. Findings The method has been tested in both simulations with a real UR3 robot for several practical applications. The results of this paper indicate that the proposed approach can effectively make the robot safety-aware and learn how to divert its trajectory to avoid accidents with humans within the workspace. Research limitations/implications The method has been tested in both simulations with a real UR3 robot in several practical applications. The results indicate that the proposed approach can effectively make the robot be aware of safety and learn how to change its trajectory to avoid accidents with persons within the workspace. Originality/value This paper provides a novel collision avoidance framework that allows robots to work alongside human operators in unstructured and complex environments. The method uses end-to-end policy training to directly extract the optimal path from the visual inputs for the scene.

Random Neural Q-Learning for Obstacle Avoidance of A Mobile Robot in Unknown Environments

Least Mean P-Power Extreme Learning Machine For Obstacle Avoidance Of A Mobile Robot

Intelligent Obstacle Avoidance Algorithm for Mobile Robots in Uncertain Environment

Reinforcement Learning For Mobile Robot Obstacle Avoidance Under Dynamic Environments

Autonomous Exploration for Mobile Robot using Q-learning

Experimental Research on Avoidance Obstacle Control for Mobile Robots Using Q-Learning (QL) and Deep Q-Learning (DQL) Algorithms in Dynamic Environments

Bidirectional Obstacle Avoidance Enhancement‐Deep Deterministic Policy Gradient: A Novel Algorithm for Mobile‐Robot Path Planning in Unknown Dynamic Environments

An anti-collision algorithm for robotic search-and-rescue tasks in unknown dynamic environments

Addressing unpredictable movements of dynamic obstacles with deep reinforcement learning to ensure safe navigation for omni-wheeled mobile robot

A Bayesian Neural Network-based Obstacle Avoidance Algorithm for an Educational Autonomous Mobile Robot Platform

Deep Reinforcement Learning of Map-Based Obstacle Avoidance for Mobile Robot Navigation

Autonomous Obstacle-Avoiding Movement in Unknown Environments

An Efficient Approach for Obstacle Avoidance and Navigation in Robots

An Improved Dyna-Q Algorithm for Mobile Robot Path Planning in Unknown Dynamic Environment

Intelligent mobile robot navigation in unknown and complex environment using reinforcement learning technique

Deep Reinforcement Learning-based Obstacle Avoidance for Robot Movement in Warehouse Environments

Dynamic Path Planning of Unknown Environment Based on Deep Reinforcement Learning

Robot obstacle avoidance system using deep reinforcement learning

Ad Hoc-Obstacle Avoidance-Based Navigation System Using Deep Reinforcement Learning for Self-Driving Vehicles

Dynamic Obstacle Avoidance Technique for Mobile Robot Navigation Using Deep Reinforcement Learning

Towards Monocular Vision based Obstacle Avoidance through Deep Reinforcement Learning