Abstract:Mobile Manipulation (MM) systems are ideal candidates for taking up the role of a personal assistant in unstructured real-world environments. Among other challenges, MM requires effective coordination of the robot's embodiments for executing tasks that require both mobility and manipulation. Reinforcement Learning (RL) holds the promise of endowing robots with adaptive behaviors, but most methods require prohibitively large amounts of data for learning a useful control policy. In this work, we study the integration of robotic reachability priors in actor-critic RL methods for accelerating the learning of MM for reaching and fetching tasks. Namely, we consider the problem of optimal base placement and the subsequent decision of whether to activate the arm for reaching a 6D target. For this, we devise a novel Hybrid RL method that handles discrete and continuous actions jointly, resorting to the Gumbel-Softmax reparameterization. Next, we train a reachability prior using data from the operational robot workspace, inspired by classical methods. Subsequently, we derive Boosted Hybrid RL (BHyRL), a novel algorithm for learning Q-functions by modeling them as a sum of residual approximators. Every time a new task needs to be learned, we can transfer our learned residuals and learn the component of the Q-function that is task-specific, hence, maintaining the task structure from prior behaviors. Moreover, we find that regularizing the target policy with a prior policy yields more expressive behaviors. We evaluate our method in simulation in reaching and fetching tasks of increasing difficulty, and we show the superior performance of BHyRL against baseline methods. Finally, we zero-transfer our learned 6D fetching policy with BHyRL to our MM robot TIAGo++. For more details and code release, please refer to our project site: <a class="link-external link-http" href="http://irosalab.com/rlmmbp" rel="external noopener nofollow">this http URL</a>

Learning Efficient Robot Arm Reaching

Robot Arm Reaching Based on Inner Rehearsal

Learning Robust Skills for Tightly Coordinated Arms in Contact-Rich Tasks

Developing Robot Reaching Skill with Relative-Location Based Approximating

Learning Arm Movements Of Target Reaching For Humanoid Robot

A learning framework for semantic reach-to-grasp tasks integrating machine learning and optimization.

Optimizing Robot Arm Reaching Ability with Different Joints Functionality

Developing Robot Reaching Skill Via Look-ahead Planning

Stage-Wise Learning of Reaching Using Little Prior Knowledge

Robot Learning of Mobile Manipulation with Reachability Behavior Priors

High-Precise Robot Arm Manipulation based on Online Iterative Learning and Forward Simulation with Positioning Error Below End-Effector Physical Minimum Displacement

Towards Accurate Task Accomplishment with Low-Cost Robotic Arms

Robot Arm Configuration Self-Awareness Via Interacting with Environment

Constrained Reinforcement Learning for Dexterous Manipulation

A High-Efficient Reinforcement Learning Approach for Dexterous Manipulation

Model-Based Reinforcement Learning for Robotic Arm Control with Limited Environment Interaction

Learning to Regrasp Using Visual–Tactile Representation-Based Reinforcement Learning

One-shot sim-to-real transfer policy for robotic assembly via reinforcement learning with visual demonstration

Guiding real-world reinforcement learning for in-contact manipulation tasks with Shared Control Templates

Integrating DeepRL with Robust Low-Level Control in Robotic Manipulators for Non-Repetitive Reaching Tasks

Precise and Dexterous Robotic Manipulation via Human-in-the-Loop Reinforcement Learning