Abstract:The industrial manufacturing sector is undergoing a tremendous revolution moving from traditional production processes to intelligent techniques. Under this revolution, known as Industry 4.0 (I40), a robot is no longer static equipment but an active workforce to the factory production alongside human operators. Safety becomes crucial for humans and robots to ensure a smooth production run in such environments. The loss of operating moving robots in plant evacuation can be avoided with the adequate safety induction for them. Operators are subject to frequent safety inductions to react in emergencies, but very little is done for robots. Our research proposes an experimental safety response mechanism for a small manufacturing plant, through which an autonomous robot learns the obstacle-free trajectory to the closest safety exit in emergencies. We implement a reinforcement learning (RL) algorithm, Q-learning, to enable the path learning abilities of the robot. After obtaining the robot optimal path selection options with Q-learning, we code the outcome as a rule-based system for the safety response. We also program a speech recognition system for operators to react timeously, with a voice command, to an emergency that requires stopping all plant activities even when they are far away from the emergency stops (ESTOPs) button. An ESTOP or a voice command sent directly to the factory central controller can give the factory an emergency signal. We tested this functionality on real hardware from an S7-1200 Siemens programmable logic controller (PLC). We simulate a simple and small manufacturing environment overview to test our safety procedure. Our results show that the safety response mechanism successfully generates paths without obstacles to the closest safety exits from all the factory locations. Our research benefits any manufacturing SME intending to implement the initial and primary use of autonomous moving robots (AMR) in their factories. It also impacts manufacturing SMEs using legacy devices such as traditional PLCs by offering them intelligent strategies to incorporate current state-of-the-art technologies such as speech recognition to improve their performances. Our research empowers SMEs to adopt advanced and innovative technological concepts within their operations.

Robot Autonomous Avoidance System Based on Reinforcement Learning in 6G Network Scenarios

Robot Simulation and Reinforcement Learning Training Platform Based on Distributed Architecture.

RL and ANN Based Modular Path Planning Controller for Resource-Constrained Robots in the Indoor Complex Dynamic Environment

Robot obstacle avoidance system using deep reinforcement learning

Enhanced method for reinforcement learning based dynamic obstacle avoidance by assessment of collision risk

Deep-Reinforcement-Learning-Based Collision Avoidance of Autonomous Driving System for Vulnerable Road User Safety

Adaptive Environment Modeling Based Reinforcement Learning for Collision Avoidance in Complex Scenes

A safe reinforcement learning approach for autonomous navigation of mobile robots in dynamic environments

Obstacle avoidance planning of autonomous vehicles using deep reinforcement learning

Distributed Non-Communicating Multi-Robot Collision Avoidance Via Map-Based Deep Reinforcement Learning

From Hype to Reality: The Road Ahead of Deploying DRL in 6G Networks

Dynamic Obstacle Avoidance Technique for Mobile Robot Navigation Using Deep Reinforcement Learning

SSRL: A Safe and Smooth Reinforcement Learning Approach for Collision Avoidance in Navigation

Safety-Driven Deep Reinforcement Learning Framework for Cobots: A Sim2Real Approach

Reinforcement Learning For Mobile Robot Obstacle Avoidance Under Dynamic Environments

Deep Reinforcement Learning Enables Joint Trajectory and Communication in Internet of Robotic Things

Autonomous Obstacle Avoidance Control Method Based on Safe Adaptive Reinforcement Learning

Autonomous obstacle avoidance of UAV based on deep reinforcement learning

Reinforce Learning-Based Collision Avoidance in Network Assisted Automated Driving

Training Is Execution: A Reinforcement Learning-Based Collision Avoidance Algorithm for Volatile Scenarios

An Experimental Safety Response Mechanism for an Autonomous Moving Robot in a Smart Manufacturing Environment Using Q-Learning Algorithm and Speech Recognition