Abstract:Social robotics represents a branch of human-robot interaction dedicated to developing systems to control the robots to operate in unstructured environments with the presence of human beings. Social robots must interact with human beings by understanding social signals and responding appropriately to them. Most social robots are still pre-programmed, not having great ability to learn and respond with actions adequate during an interaction with humans. Recently more elaborate methods use body movements, gaze direction, and body language. However, these methods generally neglect vital signs present during an interaction, such as the human emotional state. In this article, we address the problem of developing a system to turn a robot able to decide, autonomously, what behaviors to emit in the function of the human emotional state. From one side, the use of Reinforcement Learning (RL) represents a way for social robots to learn advanced models of social cognition, following a self-learning paradigm, using characteristics automatically extracted from high-dimensional sensory information. On the other side, Deep Learning (DL) models can help the robots to capture information from the environment, abstracting complex patterns from the visual information. The combination of these two techniques is known as Deep Reinforcement Learning (DRL). The purpose of this work is the development of a DRL system to promote a natural and socially acceptable interaction among humans and robots. For this, we propose an architecture, Social Robotics Deep Q-Network (SocialDQN), for teaching social robots to behave and interact appropriately with humans based on social signals, especially on human emotional states. This constitutes a relevant contribution for the area since the social signals must not only be recognized by the robot but help him to take action appropriated according to the situation presented. Characteristics extracted from people's faces are considered for extracting the human emotional state aiming to improve the robot perception. The development and validation of the system are carried out with the support of SimDRLSR simulator. Results obtained through several tests demonstrate that the system learned satisfactorily to maximize the rewards, and consequently, the robot behaves in a socially acceptable way.

Teaching Drones on the Fly: Can Emotional Feedback Serve as Learning Signal for Training Artificial Agents?

Human-Robot Emotional Interaction Model Based on Reinforcement Learning

Human Social Feedback for Efficient Interactive Reinforcement Agent Learning

Affective Behavior Learning for Social Robot Haru with Implicit Evaluative Feedback

Social Interaction with Drones using Human Emotion Recognition

Emotion Appropriateness in Human–Drone Interaction

How Much Progress Did I Make? An Unexplored Human Feedback Signal for Teaching Robots

Teaching Robots to Span the Space of Functional Expressive Motion

Prosody as a Teaching Signal for Agent Learning: Exploratory Studies and Algorithmic Implications

Nonverbal Robot Feedback for Human Teachers

Human-Robot Mutual Learning through Affective-Linguistic Interaction and Differential Outcomes Training [Pre-Print]

Towards Learning from Implicit Human Reward: (extended Abstract)

Learning from Human Reward Benefits from Socio-Competitive Feedback

Using Informative Behavior to Increase Engagement While Learning from Human Reward.

Towards personalized human AI interaction - adapting the behavior of AI agents using neural signatures of subjective interest

Social Interaction for Efficient Agent Learning from Human Reward.

Reinforcement Learning based Embodied Agents Modelling Human Users Through Interaction and Multi-Sensory Perception

Deep Q-network for social robotics using emotional social signals

A Human-Robot Mutual Learning System with Affect-Grounded Language Acquisition and Differential Outcomes Training

Leveraging social networks to motivate humans to train agents.

UvA-DARE ( Digital Academic Repository ) Using Informative Behavior to Increase Engagement While Learning from Human Reward