Abstract:Robots are increasingly operating in highly complex and dynamic scenarios where they must continuously perceive their environment, learn from new experiences, and apply acquired knowledge to complete their tasks effectively. In these environments, the potential situations a robot encounters can become too vast to handle with predefined conditions. As a result, autonomous robots must incorporate learning methods that accurately represent the environment, make informed decisions, and optimize learning speed, task performance, and computational resources. Given the recent advancements of Deep Reinforcement Learning over classical Reinforcement Learning, this paper presents a Deep Reinforcement Learning system for biologically inspired, socially-driven decision-making in autonomous robots operating in such intricate environments with countless variations. This work formulates a learning framework as a Markov Decision Process, enabling robots to demonstrate adaptive social behaviour by integrating internal and external factors. The robot's state includes 11 variables derived from the robot's motivations, user perception, ambient light, and social norms, allowing the robot to select from ten possible actions autonomously. This study aims to develop fully autonomous robots that operate autonomously, learning and adapting to complex environments while maintaining an optimal balance between the robot's internal and social well-being. We compare eight state-of-the-art DRL algorithms to identify the best-performing approach and implement the learning system into our Mini social robot. The results highlight Rainbow as the most effective solution, enabling the Mini robot to exhibit highly adaptive, autonomous behaviour in challenging social environments. These results allow autonomous robots to increase their capabilities and reduce human supervision.

Deep Dive into Model-free Reinforcement Learning for Biological and Robotic Systems: Theory and Practice

Deep Model-Based Reinforcement Learning for Predictive Control of Robotic Systems with Dense and Sparse Rewards

How to Train Your Robot with Deep Reinforcement Learning; Lessons We've Learned

A Survey of Deep Network Solutions for Learning Control in Robotics: From Reinforcement to Imitation

A Survey of Sim-to-Real Transfer Techniques Applied to Reinforcement Learning for Bioinspired Robots

How to train your robot with deep reinforcement learning: lessons we have learned

Deep Reinforcement Learning for the Control of Robotic Manipulation: A Focussed Mini-Review

Survey of Model-Based Reinforcement Learning: Applications on Robotics

Offline Reinforcement Learning of Robotic Control Using Deep Kinematics and Dynamics

Deep Model-Based Reinforcement Learning for High-Dimensional Problems, a Survey

Data-Efficient Model-Based Reinforcement Learning For Robot Control

Deep Reinforcement Learning for the Biologically Inspired Social Behaviour of Autonomous Robots Acting in Dynamic Environments

Deep Reinforcement Learning for Robotic Manipulation-The state of the art

Deep Reinforcement Learning for Motion Control Algorithms in Robotics

Discovering Latent States for Model Learning: Applying Sensorimotor Contingencies Theory and Predictive Processing to Model Context

Deep Reinforcement Learning for Robotics: A Survey of Real-World Successes

Deep-learning in Mobile Robotics - from Perception to Control Systems: A Survey on Why and Why Not.

Reinforcement Learning for High-dimensional Continuous Control in Biomechanics: An Intro to ArtiSynth-RL

Depth Control of a Biomimetic Manta Robot Via Reinforcement Learning

Model-Based Reinforcement Learning In Continuous Environments Using Real-Time Constrained Optimization

Reinforcement Learning in Robotics: Challenges and Applications