Abstract:Robots capable of performing manipulation tasks in a broad range of missions in unstructured environments can develop numerous applications to impact and enhance human life. Existing work in robot learning has shown success in applying conventional machine learning algorithms to enable robots for replicating rather simple manipulation tasks in manufacturing, service and healthcare applications, among others. However, learning robust and versatile models for complex manipulation tasks that are inherently multi-faceted and naturally intricate demands algorithmic advancements in robot learning. Our research supports the long-term goal of making robots more accessible and serviceable to the general public by expanding robot applications to real-world scenarios that require systems capable of performing complex tasks. To achieve this goal, we focus on identifying and investigating knowledge gaps in robot learning of complex manipulation tasks by leveraging upon human-robot interaction and robot learning from human instructions. This document presents an overview of the recent research developments in the Persistent Autonomy and Robot Learning (PeARL) lab at the University of Massachusetts Lowell. Here, I briefly discuss different research directions, and present a few proposed approaches in our most recent publications. For each proposed approach, I then mention potential future directions that can advance the field.

What problem does this paper attempt to address?

The paper primarily explores how to enable robots to perform complex and multifaceted operational tasks, especially in unstructured environments. The core objective of the research is to expand the application range of robots in the real world by improving their learning capabilities, making them more accessible and serviceable to the public's needs. To achieve this goal, the research team focuses on addressing the key challenges faced by robots when learning complex operational tasks and explores solutions using human-robot interaction and human-guided robot learning methods. Specifically, the paper mentions the following main research directions: 1. **Primitive Skill Modeling Based on Elastic Graphs**: A new optimization-based learning method is proposed, which uses elastic graphs (a graph where nodes are connected by springs) to encode human demonstrations. This method not only effectively fits the demonstration data but also allows learning skills from a single demonstration and shows good performance under various metrics. 2. **Constrained Skill Reproduction Based on Perturbation Analysis**: By constructing a convex optimization problem represented in the form of an elastic graph and utilizing strong duality and perturbation analysis, a confidence metric is created. This method can reproduce skills according to different confidence levels, achieving varying degrees of smoothness and flexibility. 3. **Learning Skills from Successful and Failed Demonstrations**: A new learning method is proposed that can learn skills from both successful and failed demonstrations. This method constructs a statistical skill model that can find the optimal skill reproduction scheme under new conditions, tending towards successful cases while avoiding failed ones. 4. **Similarity-Aware Multi-Representation Skill Learning**: To address the consistency issue of existing learning methods when boundary conditions change significantly, a framework containing multiple learning representations and similarity metrics is proposed. This framework can find the most similar skill reproduction under given boundary conditions, thereby improving the generalization ability of skills. These research directions collectively advance the field of robot learning and provide a theoretical and technical foundation for developing more powerful, flexible, and adaptive robotic systems in the future.

Research Report -- Persistent Autonomy and Robot Learning Lab

Perception-enhancement Based Task Learning and Action Scheduling for Robotic Limb in CPS Environment

Fully Autonomous Real-World Reinforcement Learning with Applications to Mobile Manipulation

Robotic Manipulation with Reinforcement Learning, State Representation Learning, and Imitation Learning (Student Abstract)

Towards Long-term Autonomy: A Perspective from Robot Learning

A Survey of Embodied Learning for Object-Centric Robotic Manipulation

Lifelong Robot Library Learning: Bootstrapping Composable and Generalizable Skills for Embodied Control with Language Models

A Review on Robot Manipulation Methods in Human-Robot Interactions

Lifelong Robot Learning with Human Assisted Language Planners

Robot Learning of Mobile Manipulation with Reachability Behavior Priors

Survey of Learning Approaches for Robotic In-Hand Manipulation

Autonomous Robotic Reinforcement Learning with Asynchronous Human Feedback

Robot learning on the job: Human-in-the-loop autonomy and learning during deployment

Survey of Learning-based Approaches for Robotic In-Hand Manipulation

Grounding Language Models in Autonomous Loco-manipulation Tasks

Learning Visual Tracking and Reaching with Deep Reinforcement Learning on a UR10e Robotic Arm

Language, Camera, Autonomy! Prompt-engineered Robot Control for Rapidly Evolving Deployment

Precise and Dexterous Robotic Manipulation via Human-in-the-Loop Reinforcement Learning

Continuously Improving Mobile Manipulation with Autonomous Real-World RL

Machine Learning Meets Advanced Robotic Manipulation

Enhancing Robotic Manipulation: Harnessing the Power of Multi-Task Reinforcement Learning and Single Life Reinforcement Learning in Meta-World