Abstract:Purpose Most manufacturing plants choose the easy way of completely separating human operators from robots to prevent accidents, but as a result, it dramatically affects the overall quality and speed that is expected from human–robot collaboration. It is not an easy task to ensure human safety when he/she has entered a robot’s workspace, and the unstructured nature of those working environments makes it even harder. The purpose of this paper is to propose a real-time robot collision avoidance method to alleviate this problem. Design/methodology/approach In this paper, a model is trained to learn the direct control commands from the raw depth images through self-supervised reinforcement learning algorithm. To reduce the effect of sample inefficiency and safety during initial training, a virtual reality platform is used to simulate a natural working environment and generate obstacle avoidance data for training. To ensure a smooth transfer to a real robot, the automatic domain randomization technique is used to generate randomly distributed environmental parameters through the obstacle avoidance simulation of virtual robots in the virtual environment, contributing to better performance in the natural environment. Findings The method has been tested in both simulations with a real UR3 robot for several practical applications. The results of this paper indicate that the proposed approach can effectively make the robot safety-aware and learn how to divert its trajectory to avoid accidents with humans within the workspace. Research limitations/implications The method has been tested in both simulations with a real UR3 robot in several practical applications. The results indicate that the proposed approach can effectively make the robot be aware of safety and learn how to change its trajectory to avoid accidents with persons within the workspace. Originality/value This paper provides a novel collision avoidance framework that allows robots to work alongside human operators in unstructured and complex environments. The method uses end-to-end policy training to directly extract the optimal path from the visual inputs for the scene.

A Realtime Algorithm for Distinguish Obstacle from Accessible Area in 3D Scene

Obstacle Detection In Unstructured Environment With A Single Camera And Linear Method

Real-time dynamic obstacle detection and tracking using 3D Lidar

Monocular Vision Based Obstacle Detection for Robot Navigation in Unstructured Environment

Real-Time Navigation In Dynamic Human Environments Using Optimal Reciprocal Collision Avoidance

Robot visual perception and autonomous obstacle avoidance based on deep learning

Detecting More Objects Indoors: a Depth-guided Detector for Mobile Robots

A ground and obstacle detection algorithm for the visually impaired

Real‐time 3D multi‐pedestrian detection and tracking using 3D LiDAR point cloud for mobile robot

Real-time Obstacle Map Reconstruction by Sensors with Limited Field of View for Vision Based Autonomous Robot

Real-Time Objects Recognition and Obstacles Avoidance for Mobile Robot

Real-time Obstacle Avoidance for a Mobile Robot in an Uncertain Environment

A real-time dynamic obstacle tracking and mapping system for UAV navigation and collision avoidance with an RGB-D camera

Robot obstacle avoidance system using deep reinforcement learning

Obstacle detection and recognition in natural terrain for field mobile robot navigation

Real-Time Avoidance Strategy of Dynamic Obstacles via Half Model-Free Detection and Tracking With 2D Lidar for Mobile Robots

Adaptive ground segmentation method for real-time mobile robot control

A Real-Time Multi-Constraints Obstacle Avoidance Method Using LiDAR

Vision-Based Real-Time Traversable Region Detection for Mobile Robot in the Outdoors

Real Time Obstacle Estimation Based on Dense Stereo Vision for Robotic Lawn Mowers.

Online Efficient Safety-Critical Control for Mobile Robots in Unknown Dynamic Multi-Obstacle Environments