Abstract:Social robotics represents a branch of human-robot interaction dedicated to developing systems to control the robots to operate in unstructured environments with the presence of human beings. Social robots must interact with human beings by understanding social signals and responding appropriately to them. Most social robots are still pre-programmed, not having great ability to learn and respond with actions adequate during an interaction with humans. Recently more elaborate methods use body movements, gaze direction, and body language. However, these methods generally neglect vital signs present during an interaction, such as the human emotional state. In this article, we address the problem of developing a system to turn a robot able to decide, autonomously, what behaviors to emit in the function of the human emotional state. From one side, the use of Reinforcement Learning (RL) represents a way for social robots to learn advanced models of social cognition, following a self-learning paradigm, using characteristics automatically extracted from high-dimensional sensory information. On the other side, Deep Learning (DL) models can help the robots to capture information from the environment, abstracting complex patterns from the visual information. The combination of these two techniques is known as Deep Reinforcement Learning (DRL). The purpose of this work is the development of a DRL system to promote a natural and socially acceptable interaction among humans and robots. For this, we propose an architecture, Social Robotics Deep Q-Network (SocialDQN), for teaching social robots to behave and interact appropriately with humans based on social signals, especially on human emotional states. This constitutes a relevant contribution for the area since the social signals must not only be recognized by the robot but help him to take action appropriated according to the situation presented. Characteristics extracted from people's faces are considered for extracting the human emotional state aiming to improve the robot perception. The development and validation of the system are carried out with the support of SimDRLSR simulator. Results obtained through several tests demonstrate that the system learned satisfactorily to maximize the rewards, and consequently, the robot behaves in a socially acceptable way.

Human-Robot Emotional Interaction Model Based on Reinforcement Learning

Emotion Regulation Based on Multi-objective Weighted Reinforcement Learning for Human-robot Interaction

A MultiModal Social Robot Toward Personalized Emotion Interaction

Multi-Modal Based Fuzzy Atmosfield in Human-Robot Interaction

Dynamic Emotion Understanding in Human–Robot Interaction Based on Two-Layer Fuzzy SVR-TS Model

A Multimodal Emotional Communication Based Humans-Robots Interaction System

Empathizing with Emotional Robot Based on Cognition Reappraisal

Affective Behavior Learning for Social Robot Haru with Implicit Evaluative Feedback

Cognitive Emotional Regulation Model in Human-Robot Interaction

Affective Human-Robot Interaction with Multimodal Explanations

An Emotion-Driven Attention Model For Service Robot

A Facial Expression Emotion Recognition Based Human-robot Interaction System

Shaping Haru’s Affective Behavior with Valence and Arousal Based Implicit Facial Feedback

Multi-Modal Hierarchical Empathetic Framework for Social Robots With Affective Body Control

Robot Emotion and Performance Regulation Based on HMM

An emotion-driven and topic-aware dialogue framework for human–robot interaction

Interactive Robot Learning for Multimodal Emotion Recognition.

Evaluation of Robot Emotion Expressions for Human–Robot Interaction

Affect-Driven Learning of Robot Behaviour for Collaborative Human-Robot Interactions

Real-time emotion generation in human-robot dialogue using large language models

Deep Q-network for social robotics using emotional social signals