Abstract:One of the most crucial steps toward achieving human-like manipulation skills in robots is to incorporate compliance into the robot controller. Compliance not only makes the robot's behaviour safe but also makes it more energy efficient. In this direction, the variable impedance control (VIC) approach provides a framework for a robot to adapt its compliance during execution by employing an adaptive impedance law. Nevertheless, autonomously adapting the compliance profile as demanded by the task remains a challenging problem to be solved in practice. In this work, we introduce a reinforcement learning (RL)-based approach called DEVILC (Data-Efficient Variable Impedance Learning Controller) to learn the variable impedance controller through real-world interaction of the robot. More concretely, we use a model-based RL approach in which, after every interaction, the robot iteratively learns a probabilistic model of its dynamics using the Gaussian process regression model. The model is then used to optimize a neural-network policy that modulates the robot's impedance such that the long-term reward for the task is maximized. Thanks to the model-based RL framework, DEVILC allows a robot to learn the VIC policy with only a few interactions, making it practical for real-world applications. In simulations and experiments, we evaluate DEVILC on a Franka Emika Panda robotic manipulator for different manipulation tasks in the Cartesian space. The results show that DEVILC is a promising direction toward autonomously learning compliant manipulation skills directly in the real world through interactions. A video of the experiments is available in the link: https://youtu.be/_uyr0Vye5no.

Deep Model Predictive Variable Impedance Control

Learning and Generalizing Variable Impedance Manipulation Skills from Human Demonstrations

Unified Motion/Force/Impedance Control for Manipulators in Unknown Contact Environments Based on Robust Model-Reaching Approach

Adaptive Variable Impedance Control for a Modular Soft Robot Manipulator in Configuration Space

A Unified Parametric Representation for Robotic Compliant Skills with Adaptation of Impedance and Force

Use of an artificial neuroadaptive robot model to describe adaptive and learning motor mechanisms in the central nervous system

Data-Efficient Reinforcement Learning for Variable Impedance Control

Impedance Control of Space Manipulator Based on Deep Reinforcement Learning

An Approach for Robotic Leaning Inspired by Biomimetic Adaptive Control

Self-Adaptive Robust Motion Planning for High DoF Robot Manipulator using Deep MPC

Contact-Implicit Model Predictive Control for Dexterous In-hand Manipulation: A Long-Horizon and Robust Approach

Adaptive Impedance Control for Compliantly Actuated Robots with a Unified Safety Measure

Learning Variable Impedance Skills from Demonstrations with Passivity Guarantee

Toward Impedance Control in Human-Machine Interfaces for Upper-Limb Prostheses

Variable Impedance Control and Learning—A Review

Model Predictive Robot-Environment Interaction Control for Mobile Manipulation Tasks

A neural network based framework for variable impedance skills learning from demonstrations

Composite Learning Variable Impedance Robot Control With Stability and Passivity Guarantees

Toward a Framework for Adaptive Impedance Control of an Upper-limb Prosthesis

Variable Inertia Model Predictive Control for Fast Bipedal Maneuvers

Real-Time Deformable-Contact-Aware Model Predictive Control for Force-Modulated Manipulation