Abstract:Social robotics represents a branch of human-robot interaction dedicated to developing systems to control the robots to operate in unstructured environments with the presence of human beings. Social robots must interact with human beings by understanding social signals and responding appropriately to them. Most social robots are still pre-programmed, not having great ability to learn and respond with actions adequate during an interaction with humans. Recently more elaborate methods use body movements, gaze direction, and body language. However, these methods generally neglect vital signs present during an interaction, such as the human emotional state. In this article, we address the problem of developing a system to turn a robot able to decide, autonomously, what behaviors to emit in the function of the human emotional state. From one side, the use of Reinforcement Learning (RL) represents a way for social robots to learn advanced models of social cognition, following a self-learning paradigm, using characteristics automatically extracted from high-dimensional sensory information. On the other side, Deep Learning (DL) models can help the robots to capture information from the environment, abstracting complex patterns from the visual information. The combination of these two techniques is known as Deep Reinforcement Learning (DRL). The purpose of this work is the development of a DRL system to promote a natural and socially acceptable interaction among humans and robots. For this, we propose an architecture, Social Robotics Deep Q-Network (SocialDQN), for teaching social robots to behave and interact appropriately with humans based on social signals, especially on human emotional states. This constitutes a relevant contribution for the area since the social signals must not only be recognized by the robot but help him to take action appropriated according to the situation presented. Characteristics extracted from people's faces are considered for extracting the human emotional state aiming to improve the robot perception. The development and validation of the system are carried out with the support of SimDRLSR simulator. Results obtained through several tests demonstrate that the system learned satisfactorily to maximize the rewards, and consequently, the robot behaves in a socially acceptable way.

Robot gains Social Intelligence through Multimodal Deep Reinforcement Learning

Intrinsically motivated reinforcement learning for human-robot interaction in the real-world

Training an Interactive Humanoid Robot Using Multimodal Deep Reinforcement Learning

A Data-Efficient Deep Learning Approach for Deployable Multimodal Social Robots

Deep Q-network for social robotics using emotional social signals

Multimodal integration learning of robot behavior using deep neural networks

Multimodal Reinforcement Learning for Robots Collaborating with Humans

Deep Reinforcement Learning for the Biologically Inspired Social Behaviour of Autonomous Robots Acting in Dynamic Environments

Why Robots Should Be Social: Enhancing Machine Learning through Social Human-Robot Interaction

Human-Robot Emotional Interaction Model Based on Reinforcement Learning

Multi-Robot Behavior Adaptation to Humans' Intention in Human-Robot Interaction Using Information-Driven Fuzzy Friend-Q Learning.

Modular Deep Q Networks for Sim-to-real Transfer of Visuo-motor Policies

Learning Socially Appropriate Robot Approaching Behavior Toward Groups using Deep Reinforcement Learning

Teaching NICO How to Grasp: An Empirical Study on Crossmodal Social Interaction as a Key Factor for Robots Learning From Humans

Human-Robot Collaboration via Deep Reinforcement Learning of Real-World Interactions

Learning from humans to build social cognition among robots

Machine Learning for Social Multiparty Human-Robot Interaction

Reinforcement Learning Approaches in Social Robotics

A MultiModal Social Robot Toward Personalized Emotion Interaction

A data-efficient goal-directed deep reinforcement learning method for robot visuomotor skill

Machine Learning of Social States and Skills for Multi-Party Human-Robot Interaction