Abstract:One of the most crucial steps toward achieving human-like manipulation skills in robots is to incorporate compliance into the robot controller. Compliance not only makes the robot's behaviour safe but also makes it more energy efficient. In this direction, the variable impedance control (VIC) approach provides a framework for a robot to adapt its compliance during execution by employing an adaptive impedance law. Nevertheless, autonomously adapting the compliance profile as demanded by the task remains a challenging problem to be solved in practice. In this work, we introduce a reinforcement learning (RL)-based approach called DEVILC (Data-Efficient Variable Impedance Learning Controller) to learn the variable impedance controller through real-world interaction of the robot. More concretely, we use a model-based RL approach in which, after every interaction, the robot iteratively learns a probabilistic model of its dynamics using the Gaussian process regression model. The model is then used to optimize a neural-network policy that modulates the robot's impedance such that the long-term reward for the task is maximized. Thanks to the model-based RL framework, DEVILC allows a robot to learn the VIC policy with only a few interactions, making it practical for real-world applications. In simulations and experiments, we evaluate DEVILC on a Franka Emika Panda robotic manipulator for different manipulation tasks in the Cartesian space. The results show that DEVILC is a promising direction toward autonomously learning compliant manipulation skills directly in the real world through interactions. A video of the experiments is available in the link: https://youtu.be/_uyr0Vye5no.

Composite Learning Variable Impedance Robot Control With Stability and Passivity Guarantees

Variable Stiffness Control of a Soft Rehabilitation Robot with Sliding Mode Method

Adaptive Finite-Time Optimised Impedance Control for Robotic Manipulators with State Constraints

Variable impedance control on contact-rich manipulation of a collaborative industrial mobile manipulator: An imitation learning approach

Implementation of Impedance Control for Lower-Limb Rehabilitation Robots

Robot Variable Impedance Control and Generalizing from Human–Robot Interaction Demonstrations

An Optimal Variable Impedance Control With Consideration of the Stability

Unified Motion/Force/Impedance Control for Manipulators in Unknown Contact Environments Based on Robust Model-Reaching Approach

Learning Variable Impedance Skills from Demonstrations with Passivity Guarantee

Adaptive Variable Impedance Control for a Modular Soft Robot Manipulator in Configuration Space

Data-Efficient Reinforcement Learning for Variable Impedance Control

Adaptive Impedance Control for Compliantly Actuated Robots with a Unified Safety Measure

Deep Model Predictive Variable Impedance Control

Safe Online Gain Optimization for Variable Impedance Control

Variable Impedance Control and Learning—A Review

Impedance Learning-Based Hybrid Adaptive Control of Upper Limb Rehabilitation Robots

A practical PID variable stiffness control and its enhancement for compliant force-tracking interactions with unknown environments

Shared Autonomy via Variable Impedance Control and Virtual Potential Fields for Encoding Human Demonstration

Iterative Learning Impedance Control for Rehabilitation Robots Driven by Series Elastic Actuators

Learning Variable Admittance Control for Human-Robot Collaborative Manipulation

Learning and Generalizing Variable Impedance Manipulation Skills from Human Demonstrations