Abstract:Recent successes combine reinforcement learning algorithms and deep neural networks, despite reinforcement learning not being widely applied to robotics and real world scenarios. This can be attributed to the fact that current state-of-the-art, end-to-end reinforcement learning approaches still require thousands or millions of data samples to converge to a satisfactory policy and are subject to catastrophic failures during training. Conversely, in real world scenarios and after just a few data samples, humans are able to either provide demonstrations of the task, intervene to prevent catastrophic actions, or simply evaluate if the policy is performing correctly. This research investigates how to integrate these human interaction modalities to the reinforcement learning loop, increasing sample efficiency and enabling real-time reinforcement learning in robotics and real world scenarios. This novel theoretical foundation is called Cycle-of-Learning, a reference to how different human interaction modalities, namely, task demonstration, intervention, and evaluation, are cycled and combined to reinforcement learning algorithms. Results presented in this work show that the reward signal that is learned based upon human interaction accelerates the rate of learning of reinforcement learning algorithms and that learning from a combination of human demonstrations and interventions is faster and more sample efficient when compared to traditional supervised learning algorithms. Finally, Cycle-of-Learning develops an effective transition between policies learned using human demonstrations and interventions to reinforcement learning. The theoretical foundation developed by this research opens new research paths to human-agent teaming scenarios where autonomous agents are able to learn from human teammates and adapt to mission performance metrics in real-time and in real world scenarios.

Human-Robot Collaboration via Deep Reinforcement Learning of Real-World Interactions

Learning to Collaborate from Simulation for Robot-Assisted Dressing

Human-AI Collaboration in Real-World Complex Environment with Reinforcement Learning

An Attention-Based Deep Learning Approach for Inertial Motion Recognition and Estimation in Human-Robot Collaboration

The Ingredients of Real-World Robotic Reinforcement Learning

Enabling Multi-Robot Collaboration from Single-Human Guidance

Multimodal Reinforcement Learning for Robots Collaborating with Humans

Learning Socially Appropriate Robot Approaching Behavior Toward Groups using Deep Reinforcement Learning

Learning Physical Collaborative Robot Behaviors From Human Demonstrations

Efficient Model Learning for Human-Robot Collaborative Tasks

A reinforcement learning method for human-robot collaboration in assembly tasks

Shared Autonomy via Deep Reinforcement Learning

Simultaneously learning intentions and preferences during physical human-robot cooperation

Human-in-the-Loop Methods for Data-Driven and Reinforcement Learning Systems

Intrinsically motivated reinforcement learning for human-robot interaction in the real-world

Enhancing team performance with transfer-learning during real-world human-robot collaboration

Demonstration Guided Actor-Critic Deep Reinforcement Learning for Fast Teaching of Robots in Dynamic Environments

“Follower” to “Collaborator”: A robot proactive collaborative controller based on human multimodal information for 3D handling/assembly scenarios

Designs for Enabling Collaboration in Human-Machine Teaming via Interactive and Explainable Systems

A graph-based reinforcement learning-enabled approach for adaptive human-robot collaborative assembly operations

Robot learning on the job: Human-in-the-loop autonomy and learning during deployment