Abstract:Robots are increasingly operating in highly complex and dynamic scenarios where they must continuously perceive their environment, learn from new experiences, and apply acquired knowledge to complete their tasks effectively. In these environments, the potential situations a robot encounters can become too vast to handle with predefined conditions. As a result, autonomous robots must incorporate learning methods that accurately represent the environment, make informed decisions, and optimize learning speed, task performance, and computational resources. Given the recent advancements of Deep Reinforcement Learning over classical Reinforcement Learning, this paper presents a Deep Reinforcement Learning system for biologically inspired, socially-driven decision-making in autonomous robots operating in such intricate environments with countless variations. This work formulates a learning framework as a Markov Decision Process, enabling robots to demonstrate adaptive social behaviour by integrating internal and external factors. The robot's state includes 11 variables derived from the robot's motivations, user perception, ambient light, and social norms, allowing the robot to select from ten possible actions autonomously. This study aims to develop fully autonomous robots that operate autonomously, learning and adapting to complex environments while maintaining an optimal balance between the robot's internal and social well-being. We compare eight state-of-the-art DRL algorithms to identify the best-performing approach and implement the learning system into our Mini social robot. The results highlight Rainbow as the most effective solution, enabling the Mini robot to exhibit highly adaptive, autonomous behaviour in challenging social environments. These results allow autonomous robots to increase their capabilities and reduce human supervision.

Causal Reinforcement Learning for Optimisation of Robot Dynamics in Unknown Environments

Cautious Adaptation For Reinforcement Learning in Safety-Critical Settings

Deep Reinforcement Learning Robot for Search and Rescue Applications: Exploration in Unknown Cluttered Environments

A safe reinforcement learning approach for autonomous navigation of mobile robots in dynamic environments

Deep Reinforcement Learning for the Biologically Inspired Social Behaviour of Autonomous Robots Acting in Dynamic Environments

Reinforcement Learning Controllers for Soft Robots using Learned Environments

Experimental Evaluation of ROS-Causal in Real-World Human-Robot Spatial Interaction Scenarios

Autonomous navigation of mobile robots in unknown environments using off-policy reinforcement learning with curriculum learning

Learning by Doing: An Online Causal Reinforcement Learning Framework with Causal-Aware Policy

Selective Exploration and Information Gathering in Search and Rescue Using Hierarchical Learning Guided by Natural Language Input

R-SARL: Crowd-aware Navigation Based Deep Reinforcement Learning for Nonholonomic Robot in Complex Environments

Combining Reinforcement Learning and Causal Models for Robotics Applications

Addressing unpredictable movements of dynamic obstacles with deep reinforcement learning to ensure safe navigation for omni-wheeled mobile robot

From Continual Learning to Causal Discovery in Robotics

Learning Low-Level Causal Relations using a Simulated Robotic Arm

Bypassing the Simulation-to-reality Gap: Online Reinforcement Learning using a Supervisor

Safe Reinforcement Learning on the Constraint Manifold: Theory and Applications

Causal Counterfactuals for Improving the Robustness of Reinforcement Learning

Navigation in Unknown Dynamic Environments Based on Deep Reinforcement Learning

Robots that Learn to Safely Influence via Prediction-Informed Reach-Avoid Dynamic Games

Active Causal Structure Learning with Latent Variables: Towards Learning to Detour in Autonomous Robots