Abstract:Wheelchair-mounted robotic arms (and other assistive robots) should help their users perform everyday tasks. One way robots can provide this assistance is shared autonomy. Within shared autonomy, both the human and robot maintain control over the robot's motion: as the robot becomes confident it understands what the human wants, it increasingly intervenes to automate the task. But how does the robot know what tasks the human may want to perform in the first place? Today's shared autonomy approaches often rely on prior knowledge: for example, the robot must know the set of possible human goals a priori. In the long-term, however, this prior knowledge will inevitably break down -- sooner or later the human will reach for a goal that the robot did not expect. In this paper we propose a learning approach to shared autonomy that takes advantage of repeated interactions. Learning to assist humans would be impossible if they performed completely different tasks at every interaction: but our insight is that users living with physical disabilities repeat important tasks on a daily basis (e.g., opening the fridge, making coffee, and having dinner). We introduce an algorithm that exploits these repeated interactions to recognize the human's task, replicate similar demonstrations, and return control when unsure. As the human repeatedly works with this robot, our approach continually learns to assist tasks that were never specified beforehand: these tasks include both discrete goals (e.g., reaching a cup) and continuous skills (e.g., opening a drawer). Across simulations and an in-person user study, we demonstrate that robots leveraging our approach match existing shared autonomy methods for known goals, and outperform imitation learning baselines on new tasks. See videos here: <a class="link-external link-https" href="https://youtu.be/Plh4t3wQeIA" rel="external noopener nofollow">this https URL</a>

Autonomous Open-Ended Learning of Tasks with Non-Stationary Interdependencies

Autonomous learning of multiple, context-dependent tasks

Autotelic Reinforcement Learning in Multi-Agent Environments

Bootstrapping Adaptive Human-Machine Interfaces with Offline Reinforcement Learning

Learning a Set of Interrelated Tasks by Using Sequences of Motor Policies for a Strategic Intrinsically Motivated Learner

Active Learning of Inverse Models with Intrinsically Motivated Goal Exploration in Robots

GTHSL: A Goal-Task-Driven Hierarchical Sharing Learning Method to Learn Long-Horizon Tasks Autonomously

Intrinsically Motivated Multi-Goal Reinforcement Learning Using Robotics Environment Integrated with OpenAI Gym

Modeling Long-horizon Tasks as Sequential Interaction Landscapes

REAL-X -- Robot open-Ended Autonomous Learning Architectures: Achieving Truly End-to-End Sensorimotor Autonomous Learning Systems

Learning to Share Autonomy Across Repeated Interaction

Autonomous Robotic Reinforcement Learning with Asynchronous Human Feedback

RObotic MAnipulation Network (ROMAN) $\unicode{x2013}$ Hybrid Hierarchical Learning for Solving Complex Sequential Tasks

Interactive Robot Learning of Gestures, Language and Affordances

Grounding Language Models in Autonomous Loco-manipulation Tasks

Fully Autonomous Real-World Reinforcement Learning with Applications to Mobile Manipulation

Synthesizing Evolving Symbolic Representations for Autonomous Systems

Latent Plans for Task-Agnostic Offline Reinforcement Learning

Autotelic Agents with Intrinsically Motivated Goal-Conditioned Reinforcement Learning: A Short Survey

Skill-based Multi-objective Reinforcement Learning of Industrial Robot Tasks with Planning and Knowledge Integration

Learning to combine primitive skills: A step towards versatile robotic manipulation